DOCnaEMT HESOHE 



BD 115 893 

TITLE 

liiSTITUTIOII 

SPOHS A6EHCT 

BOEEiU KO 
PDB DATE 
SRAHT 
NOTE 



EDRS PRICE 
DESCRIPTORS 



95 



CE 005 731 



IDEHTIPIERS 



ABSTRACT 



Research and Developaent Project in Career Education. 
Pinal Report. y 

Minnesota State Dept. of Education, St. Paul. Div. of 
Vocational and Technical Education. 
Bureau of Adult, Vocational, and Technical Education 
(DHEW/OE) y Washington, D.C. 
V261035L 
14 Sep 73 

OEG-0-72-1572 ^ * 

186p.; Hot available in hard copy due to marginal 
reproducibility of original document 

l!F-$0*76 Plus Postage. HC Not Available froia SDRS. 
♦Career Education; Educational Programs; *Elementary 
Secondary Education; Interagency Coordination; 
♦Program Descriptions; Program Design; Program 
Effectiveness; *Program Evaluation; *State 
Programs 
♦Minnesota 



Eight Minnesota school districts took part in a 
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Sufnniai-y of the Report 

ky Time P<?riod Covered by the -Report: March 15, 1972 
to September 14 ^ 1973, 

Be Goals and Objectives 6£ t,he Project, 

the broad goals and objectives of this project x^ere 
. cpnsiBteint V7ith the career educatioia goals for 
. students contained in the "Position Paper on Care (Sr \ 
Education" adopted by the State Boai:d of Education 
on May 2, 1972. These goals are as follov?^*: 

; !♦ Pre'-Schuo^ ^and .Elementary Edu6atio - ' 
I Career l^diTcation is an integral part of elementary 
education./ Basic skills ^taught in the elementary 
curricul'um''are esseiutlal to career and life 
fulfillment . . * "^v^r ^ ' 

1. Jtmior High - ^ 

a) Develop a positive attitude toward self through 
awax^feness of deval6ping talent, values , and 
dnterests as thay relate to career goals* 

b) Explore opportunities in the full raiige of 
career choices and the competencies required r 

c) Develop ability to plan for meeting individual 
" "^career goals. 

3* Senior High - - ^ 

a) Explore occupational opportunities in one or 
several careers and entry-level competencies 
required. 

b) Attain competencies necessary for entry into 
an occupation -and/or for specialised education 

at the post -secondary level. 

■i * ' . 

c) kelate career choice to a life style based on 
iiiterests^ abilities ^ 'needs, and values, 

. / I ' 

d) Explore the relationship bettvcen all education 
and individual career goals. 



4. ,>-^Pbst-Secondary and Continuing Education - 

''''' * * \ 

a) Prepare for entry, level and /or advanced level 

..employment* - • 
b-h'Upgrade for job stability or career advancement. 

c) iPrepare for new or different opportunities 
'appropriate for individual abilities aaid 
interests. • 7 

'Procedures" Followed, 

Multiple sites vyere used in teonducting this project* 
in Minnesota. Eight school districts, representative 
of various economic-geographic regions of the state 
were Involved in the. project. Different models of 
career education vjere developed and impleraeiited at 
the various sites so as to provide a ma>:lmm amount 
of empirical information concerning the program. _ 
The comprehensiveness of grade level involvement from 
site to site varied as well. Project implementation, 
and coordination at each site was the responsibility 
of a local project director in each school district 
who was an administrator, counselor, or teacher; k 
project coordinator from the state staff served as 
a liaison officer for the three agency levels involved, 
local school- district, state, and federal. Because 
of a strong concern for obtaining maKiraum intormation 
prerequisite to decision-making, a heavy^mphasis 
was -placed on evaluation. Separate and distinct 
eff<orts were intitiated in conducting process, product^ 
and third party evaluation, - 

Results t Accomplishments. , 

Career education programs were developed and imple- ' 
mented at the eight sites iii the Minnesota project, 
orientation and in-service training of teachers, 
curriculum/instructional materials development, . 
dissemination, and coimmilty involvement are examples 
of -aspects of career education which were addressed . 
A functiotial process and product evaluation system 
was developed and' implemonted. AppiroKimately 570 
teachers aiid 20,000 students were involved as 
participants in the project during the grant perio.d. 



Evaluation* 

Three evaluation efforts v/ara- initiated at the stat4 
level in the course of the project, as v^ell as efforts^ 
at the local school districts* A process avaluatior>^ ' 
system was. developed whit^h incorporated optically 
scanned record sheets and computer p^•iIttout£^ to 
prdvide monthly feedback to teachers, local project 
d:irectors, and the project coordinator concerned * 
process evaluation. Instrufnents assessiliig student 
outcomes v?ere also developed and administered to 
approKiTOately 17 ,000. experimental and control students 
near the close of the 72*-73 school year. Additionally, 
in compliance t^^ith regulations contingent upon federal 
grant recipients,^ an outside agency waa contracted 
with to provide a third party evaluation! 

Conclusions and Recontnendations# 

Considerable progress has been noted in l^he project 
during the eighteen months of the grant award. \ 
Programs have been developed, implementedj, and 
evaluated, Project personnel have provided assistance 
to .pthers as resource persons in the diffiision ot 
career education concepts ♦ Generally speakix'tg,* career 
educatioi^ concepts have beexa more readily r^eceived 
aiid Integrated into the curriculum at the elemsntary 
level than at the secondary level* The following 
seem to^be some of thq key factor s^^ which must be ' 
addressed in successfully moving cWeer education 
into the mainstream of education* 

1) Administi*ativ6j support at all levels is a necessity, 

2) Ffoject directors must be provided with ©uffioienC 
time and the necessary administrative support to • 
<siniable them to carry out the responsibilities given 
to them, ' . 

3) In-service training for teachers .mu'st be readily 
available* . * 

4) School time must be made available to teachers to 
develop the necessary curricjulum/instructional 
materials for integrating career education into - 
the ongoing curriculum. 



Body of the Report 

A# P«oBlGm area toward V7hich the pto jeet was directed, 
inclt^diiig ^ef ei^encas to th^ original proposal ^ 
previous studies and expariments and related 

liter^jture. 

' ' V ' " ' 

The bro^d problem area, toward which the Research 
and Development Project in Career Education in 
Mitinesom v^as dix-ected liiay be sumriiarised in one 
question ^ How can the career education needs ^of 
the target populations in Minnesota be most effec- 
tively ^nd efficiently' addressed^ given tl]e ^conteKt 
of the Education s j^s terns /environment currently ^ ^ 
existing and tentatively planned for* Implicit 
Vithin Ehe broad problem area was a series of sub- 
problem areas or questions v?hich provided the 
substantive content fr'om which pro ject planning, 
development i and Implementation emanated ♦ Some of 
the primax-y sub-problem areas which vjere considered 
, are presented in the following narrative so as to 
provide a focus or pei'spective to the project 
planning which took place* 

No tried aaid proven models of career education were 
in existence, at the onset of this' pro ject. While 
numerous activities and projects were undertmy 
across the nation very little infonination a^iisted 
which had been substantiated by ' experience ^ repli- 
cation, and evaluation* The ^ 'state of the art'' vma 
such that little basis existed for selecting a 
particular model vjhlch could be presented as the ' 
exemplary project in career education in Minnesota. 

Consistent with* the ^j^oregoing problem was the 
diversity of educational settings which exist in 
Minnesota. Because of socio-economic^ geographic- 
factors, career education px-ogx-ams must be designed 
which meet the needs of students in local school 
districts. Xn essence this means that programs which- 
function effectively in the metropolitan area of 
Minneapolis -St* Paul are not likely to be transportable 
to the outstate regions. Likewise, programs designed 
for the more populous, southern agricultural regions 
of the state would not be particulaxdy germane to the 
• needs of studei^ts residing in the more sparsely 



populated, mining and pulp v7ood and resort regions- 
of northern Minnesota.* 

The necessity for articulating and coordinating 
efforts with existing and emerging facets of the 
educational structure /systems of the state vms 
also considered, Minnesota has a highly developed 
system of 33 post secondary area vocational-technical 
schoolsj geogi-aphically located throughout the state,, 
to provide students ready access to instruction in 
about 200 different occupations. In addition, the 
state also has tv7enty-one (21) junior-conmiunity 
colleges v^hich conduct terminal vocational-technical 
programs as well as college. transfer programs, seven 
state colleges and a university for students vjho 
wish to pui-suc a four year college degree* 

• i 

The development of a system of secondary vocational 
qenters designed for the purpose of waking vocational 
education more accessible to students in rural areas 
in Minnesota served to complement the career education 
project* Beginning as a pilot project at tvjo sites 
in 1970-71*, the center cmicept rapidly grew to the 
point vjhere approximately 28 cfenters were functional 
during, the grant period, thus providing an important ; 
component to a total program of career educatioii. * ^ 

Given the nature of the project (Research and 
Development Project in Career Education) and the \ 
broad outcome desired, if successful, (adoption anq 
implementation by other school districts) considerabi^fi 
had to be given to modes and resources by vyhich the 
concepts of career education could be made kvimm to 
educatienai agencies on whom the responsibility^ for 
program operation rested. Therefore, the avail- 
ability of a number of strategically located demon- 
stration sites and experienced resource persons 
became an integral part of the planning process. 
Dissemination and 'diffusion were viewed aS key 
components of a research and development project 
having as one of its functions the role of a change 
agent. 

Another sub-problem area meriting attention V7as the 
mattq^r of project continuation after the funding 
period was completed. Ample evidence exists of 
programs which vzere opperational only while riutside 



funds were provided and concluded when the funding 
ended. Because the' intent of the project V7as to 
assist in developing and' nmintadning an ongoing 
program of" career education (assuming the project 
would be successful) it was important to -consider 
this raatte'r at the onset of the project. 

The foregoing represent some of the major concerns 
addressed in defining the problep area tovjard which- 
the project was directed. Hovjever, they should be 
viev?ed onty as some of the major questions or 
problems which provided a perspective to the project. 
They do not indicate the total scope or range of 
matters vjhichwcC considered in defining the problem 
area. . * 

" 

Goals and Objectives of the Project. 1 

Several levels of goals and objectives existed for 
the project, each of which must be considered as it- 
relates to the preceding and succeeding levels with 
which it interfaces. 

• • 

At its broadest level the long range goal of this 
and similar projects is the development of articulated, 
comprehensive career education programs in the state. 
As was indi^tated in the previous sectio^^lating tb 
the. definition of the problem area, selected components 
of such a program currently exist in the state, some 
are in the devel'Spmental stages, vyhile. others are a's 
yet in the planning stage. A good start has bcsn^ 
made on a total program of career education, but it 
will of necessity be a- long range effort. Sh'%-m hi 
' Append A -is the "Position Paper on Career jSducation" 
adopted by the State Board of Education on May 2, 1973, 
which indicates the nature and scope of career educatlo* 
for Minnesota as seen by that body. 

A more finite obje'ctive in terms of the project itself 
was to develap and test the effectiveness of alter- 
native career education models as they relate to 
meeting the needs of students enrolled in rural, urbaii, 
and metropolitan school systems. 

Instructional objectives vjere formulated for each of 
the eight: sites 'involved in the project. Because 
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the scope of grade level participation and the! 
natui-e of actix^ities varied from site to site^ *tha 
objectives were \jritten. to reflect the pr-ogram to 
be implemented there. The iiiicial objeccivea for 
each of the sites are presented in Appendix B. * 

Because each of the project sites had slightly 
different goals 3 purposes, 'and objectives ^ it uas 
necessarj^ to translate tlie objectives into a cootooxi 
set of objectives for evaluative purposes • The 
objectives resulting from this aire Bbcsn In a section 
of the repox^t i^elating to process aiid px^oduct eval- 
uation. 

Description of^ the general project design aia i the 
procedures followed ^ including information on the 
student population, instructional ^^taff, and the 
methods, materials, instruraents, and techniques used^ 

Thi^ project involved eight school systems which 
V7ere charged v^ith the responsibility of developing 
and operating a comprehensive career education ., /'p" 
program designed to meet the specific iteeds of,*tVieir 
students. While theix" programs diffex*ed with 
i-espect to operation anS^type of career education ■■ 
model represented, each program vjas ^vjorking to^^'ard 
a common set of goals or objectives* Three of the 
project sites v^ere located in the metroj^olitan area of 
St. Paul --Minneapolis (Roseville, Osseo, White Bear 
Lake) -their si2:es* ranging-^- in population from 3,000" 
to 34,000; three other school districts vjere located ^ 
in the irural farming regions of southeastern 
Minnesota (Plainvien, Otmtonna, and Ked Wing) vjhich 
range in population from about 2,100 to 15,00<5; 
while the remaining ti^m sites, VJillmar (population -» 
14,000) and Cloquet (population 9,0^0) v^ere located 
respectively in the v?estern and nori:hern areas of 
Minnesota. Since the etuderits in each of the school 
systems located at the sit^!a vjere quite diffei-ent vjith 
respect to available occupational models, ethnic and 
socio-economic backgrounds, investigating alternative 
models and methods of providing meaningful car>eer 
education seefaed appropriate,^' 

Each of the conimunities vms- 'purposely selected for 
this project, becauaa *(a) '^It rep!ire,geiited a unique^ ,. ♦ 



opportunity to develop and test th^ effectxveness of 
alternative career models, (b) each had made a^ 
coimitriient to develop a comprehensive career education 
program, and (e) each waB geographically located to 
serve as a demonstration project v?hich other school 
systems in the area could utilize in planning, 
developing, and implomenting programs. of their ovm. 

During the year previous^ to receipt tff the pro j^fct 
grant award, each of the eight site school systems 
V7as engaged in many of the following tyoes of 
activities! (a) developing and testing-^curriculum 
materials for career education; (b) conducting pre- 
service and in-service workshops for teachers aild/or 
attending workshops offered by other educational 
institutions concerning career education; (c) 
developing 'public relations programs to ^ncourage 
the cooperation of parents, business and indiistry 
in developing meaningful career education programs;. 

(d) coiiductiiig coOTiunity occupational surveys; and 

(e) visiting other career education projects, both 
in and out-of statfa. ' ' 

Appendix C contains a map showing the geographic 
location of project sites, project titles at each 
site, school districts involved, and a description 
of the grade level involvement and focus of activities 

Administration^ of the Project 

Each of the participating school systems vms 
responsible for forrfiulating a local plan for 
developing, implementing, and evaluating a career^ 
education. program. Local project directors were 
dravm from all facets of education, i.e.j aoMiints- 
tration, teaching, and counseling. The prlmarv 
%uties of the project director for each loeal system 
consisted of such activities as: (a) planning for 
and gupervisiiig the aetivities of the local project, 
(b) at t eliding workshops dealing with numerous aspects 
of career edud^tion such as evaluation, dissemination, 
in-service training, (c) coordinatixtg, administering, 
and monitoring the evaluation system components at 
' the local level, (d) submitting progress reports to 
the §tatc Coordinator' and (e) serving as fiscal 
agent for the local project s.ite. ^ • , 
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The Divisiop "of Vocationali-Techhlcal Education > • ^ 
Minnesota Department of Education, administered the 
grant and V7as rea.ponsible for project fiscal proce- 
dures and for the supervision-consultation of the 
yarijous project sites, . 

Communications betx^een the state and local level, - 
^and -^mong the sites themselves was facilitated ^ ^ 
through the use of regular bi~mionthly meetings of 
local project directors, state staff, and career 
education project directors from .projects funded 
by other agencies and sources. 

Results and Accomplishment of the Project. 

Because x>t the emphasis placed on evaluation in 
this project, the results' and accomplishments ' - — 
reported in this section will not touch greatly 
upon career education activities used by teachers 
or student outcomes, those matters will be discussed 
in detail in the section on process and product 
evaluation. - The information contained herein will 
be more "descriptive" than "statistical!' in nature* 
Subjective observations and reports are included in 
an effort to graphically portray the breadth and 
depth of the project. " ~ 

!'lt should be noted that the influence of the project 
extended beyond the eight sites involved, and .that 
in turn the project was the recipient of benefits 
from outside sources. Whenever possible an effort 
was made to coordinate and cooperate with career 
education projects in Minnesota funded from other 
sources so 'that maKimum benefits accrued to all. 

1. Careeif education experiences were 'engaged in by 
approximately 570 teachers at the eight project 
sites, with approximately 20,000 students exposed 
to career education activities, 

2. The greatest amount of activity occurred at the 
elementary level with decreasing amounts at the 
junior and senior .high school levels. 

3. A "snow ball", effect was evident throughout the 
project in that activity generated interest which 
resulted in additional activity, thus expanding 
both numbers of teachers and grade levels involved. 



Extensive xn--service training was conducted 
at the project sites through the duration of 
the ptoject. This was in the forni of college : 
extension classes 3 pn-^campus^ cl'asses, and in- ■ 
school district workshops, / - - 

Project personnel (administrators,; teachers, 
and counselors) served ^s resource persons and 
conducted workshops for other school districts . 
wanting orientation to ^ and in-service training 
in the. career education concepts, ; „ - 

Career resource centers /laboratories v/ere set 
up at several of the site 6 to provide information 
and assistance to^ junior and senior high school 
students • ' ' ^ . 

Curriculum development activities wei^e conducted 
at all of the sites, Careex" resource guides, 
subject matter materials, curriculum guides, 
displays^ materials, games and numberous 
other items wer-e developed* A career education 
elementax-5^ curriculm guide from one site was 
selected by personnel from the Bivis ion of 
Instruction,* Minnesota Department of Education, 
for reproduction and dissemination to every 
elemen^tary school in the state. 

Performance contracting proved to be a feasible 
means<a£^encouraging teacher participation at 
the secondary level, 

Multi-^media presentations developed at ti?o of 
the project sites were in constant demand in 
orientation/in-service training progx^aiuH; and 
community meetings throughout the state. 

A pilot pro ject-^regional workshop providing 
orientation and in-service training to elementary 
administrators and teachers was conducted at one 
of the project sites. One hundred sixty^five \: 
persons from 65 schools, representing 43 school 
districts were in attendance at the yorlvshop* 
The workshop us e^ project personnel in teaching 
other teachers d:bo^ concepts of career education* 
founding tot the workshop was, drawn from an outside 
source V 



11. Project pGrsoimel conducted a mini-course on 
clhreer education at the Innovations Fair 
sponsored by Title III 5 ESEA. 

12 • Bl--monthly meetings of exemplary career education 
^^project directox^s V7ere held. These meetings 
served to facilitate communications ^ di^jsemination, 
coordination., cooperation, and in-service traiiiirig 
functions. Career education project directors 
from other programs participated in these meetings 
as vjell as state staff from other divisions in 
the Department of Education. 

13« Project personnel cooperated 'with other funding 
sources (Title III 5 ESEA; Council on Quality 
Education) in* the proposal development-reviex-? 
process as concerned career education project 
proposals. / 

14»'' A functional process and product evaluation 

system were developed and implemented. Financial 
assistance was provided by Title-^IXi, ESEA, for 
development of the pi^ocess evaluation instrument, 

15. A workshop ms conducted for tfest^ administrators 
pertaining to the instrument to be used and 
process to be, followed in conducting the' product 
evaluation. Substitute teachers from each of the 
project sites V7ere used as test administrators. 

Evaluation of the Project 

Because of the need for information for decision 
making attached to this project, special emphasis 
was given to the evaluation .component. While separate 
^ sections have been vjritteii concerning the evaluations * 
conducted, a brief overview will be pi-esented here. 

Three subsystems comprised the evaluation component, 
(1) a third party evaluation, (2) a process evalu- 
ation, and (3) a product, evaluation* An outside 
agency was contracted \!rith to conduct the third 
party evalxiation,' as per tha. regulations ^ of the grant 
award* This agency conducted on-site visits", filed 
required reports-, attended project directors meeting, 
.monitored the process and product evaluation subsys'^tems 
development, and provided feedback to personnel having" 
responsibilities for selected activities • 



The Minnesota Kesearch Coordinating; "n^^ £o| ' 

■F»or1hifk and data 60 local project dj.xe^tois, oie 
thM party evi.uatorS. and the state coordinator. , 
BeSlW reports ooncerniiig the evaluation suh-_ . 
s^steL will he fo^d in separate ^ctron^ oC thxs - 
, report* V ^ - '.^ ■ ■ ■■^ 

Conclusions;, JipllcationsV and Recortkendation^: for 
: the ;Fiitiire.\' ■ = ^:,V'' -V" ; - 

The Re^eaifch land jDevelopt^^^ f'^^Sf ^SSl t ' 
Iducation fuhded feom public Law Is, ' 

part C, SecJ 131 Ca)^as operatxonal^rom^ ^St\eriod 
1Q72 throUith September 14, ly/-^* ^l^^ a,. 

of'ti^ thefprojicrwas fonductgd at e.^^^ ^.u . 

Minnesota With approxivaately 570 

20,000 students in grades 1-12 P^^^^^^^P^^"^^ . „t. ^ 
ma lor purpose in" conducting the project at exght 
SfferSS sites was tp test alternatxve models _6f 
rareer education developed to aneet the rieeds o£ 
sSd^ntsf providing substahtive a.nformatxon 
for decision making purposes, ^ • ^ • 

The general concliiions presented herei^n relate 
nrii.Sily to prodess variables and as sUch are - 
S^icStlve in nature, reflectiiig observation, 
fee^acS anS^Bubjective opinion from many sources, 
conclusions related to product outcomes wxll^e 
foua ^n the evaluation section of thxs xepoit. 

n \ ArlTm'iiistratlve Support at all levels is vital 
(1) Admxnxstra^^^^^^ implementation 

of a career education program. While career 

rooms and laboratories and requ:i.re^the <^_. 
' Iration and support of teachers, xt xs e>.tremel> 

involved, 



(2) GdncUirrentXy^ it is unlikely that career _ l 
education can be incorporated into the 
educational mainstreatn at the local school 
district level as a. inandate from the admin-* 
Istration* Teachers need to be itivolved in 
all phases of planning > developmetit, 
implementation^ and evaltiation as conceims 

the career education program' in order for 
the concept to become a viable part of the 
curriculum* 

(3) A key peraon in the successful plannlngj 
developments and implementation of a 
career education project is the project 
director* This individual must be provided " 
With the responsibility > authority^ time^ ^. 
and resources _needed to accomplish the task, 

(4) ,The in-service training is a critical factor 

in developing and implementing a career , 
education prdgram, l*he u&e^ teachers ^ 
involved in ongoing career education projects 
as teacher training instructors 4ms proven to 
be an effective technique "in conducting teachet 
: training* 

(5) Time for the deveXopmsnt of curriculum/ " 
itistructianal matcifi;als must be. arraitged 

for teachers . "J. his task is too time consuming 
for it to be accomplished as £in "add on" ta 
the regular load. Slimmer m-iting teams and/or 
performance contracting are methods \;^hich have 
resulted in positive outcomes. . 

(6) , Evaluation needs to be addressed in a formal 

. mariner in planning career education projects. 
Outcomes ne^d to be stated . in : performanc e 
(behavioral) terms J -resources must be allocated 
for establishing- and operating an evaluation 
system^ and feedback must be provided on a 
systematic basis to ,all participants responsible 
for pro ject operation/outcomes * 

6ther reeommehdatioris ot suggestions 'for .the future 
having implications for this and other projects of 
a„like nature are as follows j 



The introductf:on of axiy new c^rnpon^nt of the 
project must be preceded by aiv orientation or 
briefing session ^or all level of personnel 
involved. iVn- tinder standing of the plapfa ^qnd- ^ ^ 
purpose of the component is essentiar to ark 
who will come in contact with it. VJ^J-le thi^ 
can become time consnniing and costly3J*ther^e is 
no knox-m means to circumvent this step if 
desired outcomes ar 6 to be achieved. 

Likewise^ a- platmed ongoing relations : 

program infdrmJLng the community at large > as 
well as School personnel about activities ^ 
events 5 'and goals > can do much to elicit 
interest in and support for a career education 
prbgram* 

The introduction and inciusion of career educati 
into the mainstream of education at the local 
school disti-ict level may be accomplished by y 
starting V7ith a tiuclaaus of interested /motivated 
teachers and administrators representing the 
various grade level$^ and proceding from there. 
This pro cedur^e is especially pertinent- where 
resoXirces are extremely limited or apathy exists 
concerning caree3r education. 

. ■ ■ ' fi " ' ■ ■ ■ ,. ^ ^ " ■ 

tHe more, precisely the des£*?ed outcomes of a^ 
.career education program caini be s%ated in. 
behavidx^al or performance ftermg the better tha 
probability that a measureable change can b6 
sjlown in :accOmpti;shing those outcomes. Students 
tfeachers^ dir^ectbrs, and administrators need 
to know in performance' terms what it is they 
are attempting to' accomplish. - 

^-^feasible method for disseminating tried and 
proven curriculum/instructional materials ^ 
methods 5. ideas 5 and experiences related to 
"pareer education needs to be developed* f 
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POSITION PAPER ON CAREER EDUCATION 

t - » ♦ 

I " ■ ■ , ■ , ■ _ • ■ ■ ' 

jk^pt^dM the State B^oard of Eduoation on May 2, 1972, 

' ■ V, • - ' • ' ■ 

TTl troductiotv • ' i. ' 

■ 1 Whereas career education is often provided in Kinnesota's 
nublic $chools as separate unrelated activities at several grade 
levels and in a number of subject matter areas, and 

']'' Wljereas there: appear to be iio^.coinmon. definitions for career, 
ediicationi, J 

Therefore, this position paper has bsen^^opted to provide 
comUn definitions to stimulate the coordination ^ of existing 
• efforts and to provide a framework for new activities. ; 

Definition ' -gi 



to v'ax'ious career, patterns . career ©auoaxion ua:.«^ ^u.cxu.c= -- the 

Se'fthool and elementary, junior high and senior, high, POBt-.^ , 

SecohdaSvt and adult levels of education. Emphasis is placed on.;-; 

secotiaaiy, anu^uux mva+iori of the world of - x^oi?. 



career proficiencv and/or specialiEed occupations , ana una^.^ 
the interrelationships between a career and one s lite sty4.c 

■ I . , ■ ■ 

- Career Education Soals fo r Students 

i The educational process should include utiliaaticlt: of ' o|cupa- 
tional resources at all levels in all careers to help t|e student 
reach _edUGational goals. 



PRE-SCHOOL AND ELEMENTARY EDUCATION 




Basic 
careei' 

each individual : 



1. Develop to the best of his/her ability., 
basic skills in communication Coral ani^ 
vjritten); computations; problem solving 
and critical thinking. | | 

2, -' Develop- a sense of self-v;orth and|sel^f- 

realir.ation. 



D 



and attaining goals. 

Begin to identify individual in-tei5e#s 
and abilities • . r I " 

20 : i • \ 



The followirig ar-e specific career .awareness goals- 
. 5. Develop an awareness of the many occupa- 
tional careers available in our socxeiy 
and their aependent and .interdependent 

relationships. 

6. Recognize that the career role of each 
. individual provides an important contri- 
* bution to our 'society* 

t. JUNIOR HI GH 

relate to career goals, ^ - 

-Explore opportunities in the full range of career^ choices 

and the competencies required. • \ 
-Develop ability' to plan for meeting individual career 

goals . . . 

SENIOR HIGH 
level ♦ 

\.Rela4i career choice to a life style based on interests, . 
abilities > needs, and values. 
-Exploit the relationship between all education and indi- 
vidual career goals . ' 

' POST-SECOHDARY AND C0NTINUXN6 EDUCATION 

-Prepare "for entry-level and/or advanced-level employment. 

-Upgrade for job stability or career advancement. 

-Prepare for new or different opportunities appropt«iate 
for individual abilities and interests. 

Policy on Career Education 

' -The policy of the" State Board of Education J^^f ^.^^ff^^f 
board in^^mms^ta Shall work J^^^^^J^Ai^.B 
pre-sdhool through grade 12. Area voc^itional tecrm^^^^ 
Shall work toward post-secondary goals and take leadci.nip 
meeting continuing education goals . ^1 . ' 
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imp?.c?raantatlpn • ' . 

- Each Staiip DapartaGJlt..of Educatioa staff m 
in implementing end evaluating dareer education pr^ograms > arid the 
assicJtattt coMiiiss loners shall divide the responsibilities in such 
a watittcj? as to accomplish the above goals . Coordination respon- 
sibilities including the responsibility fov an overall career 
education plan- shall M aosignadto a section or unit within the 
department. All local staff shall assist in ilnplementing, evalu- 
ating, and operating career education programs. , 
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APPENDIX B 



GOALS km/GB. OBJECTIVES 



LISTED BY EkQli SITE AT THE OlISET OF THE PROiJ^lCT 



Independent ScIiqoI District #94 , 
■■ ^ ■ Cloquetj Minnesota 

To develop in t^^^^^ in 
helping, students develop an awareness of the world o£ 
work/ 

A> * To meet with each indtvidtial department explaining 
4iareer conciepts^ present goals diacnss 

implemBntation o£ pro^^m^ and aslc f ^ and 
i snggestionst ^ 

B^To have a career developmaiit in-service program 
J-(2'£ hours) involving all teachers of ^jike school 
- ; v;di^trict5 January 12^ 1972. \ 

• . ■ ■ \ , »^ 

Ci To work with individual teachers on deve^oistng their" ^ 
particular career' education - general education units. 

i)r To bring in dbmmunity resource persons who could give 
teachers ih£ormatioii which would help them .to be better 
vocational advisors to theiV students. 

To make teachers ax^are of materials available 6n 
career education mid how they could be integr^ated Into 
the existing curriculum* ^> 

To develop in the student (K'-IZ) a more positive attitude 
of the importance of an individual Vs role in the broad 
spectrm of the' work world and hov/ it relates to the well- 
being of the_ c6mrnuttj.tyi 

A* To' take students on field trips V7here they can talk 
with the woirkers on the job. - 
1. Job dpportunities . 

I4 Advantages and disadvantages of the job. 
3.* Job environmental /conditions. ^ ' 
• 4* Job requirements t * " 

B. ^Ccr niake available a list o£ business and industrial ' 
firms for ,onsight visitations to view and talk with 

C, 7.6 supplement the lea,rning of childf en in ch@ funda- 
mental skill areas including niatherrtatieS js langmge aifts 
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- scietice, and social studies, * . . \ ■ > 

D* To develop hands-on activitidiS .tlirough learning "ui^its 
"in the intefmediate grades related -feo- job cltisters 
surrounciing occupations. 1 * . .. 

E. "To make availa!>le lists of patents'- of pi-itnai-y grade . , 
studentsKv^illing to share itifofmatibn about their 
occupations with their ••child's pr-itimry grade classes. 

• ■ - . '. ■> • - 

F. To develop a central file of places to visit and make 
- available to eeich primary tea&tier by December, 1971. 

III. To develop in students a positive attitude tovmrds the , - 
broad spectrxint of the world of wotk, 

A. , To make accessible* to teachers video-tapes or filnis * 
' of vis its. to places vjfhich for reasons of safety or 

inconvenieiiice do not allow large groups of children. . . 

B. To develop an cXl-^ junior high career day for the piarpose 
of having coan.iiriity and area resource peopl.e in to talk 
with the students. ' 

1., Depjartmental caree4_day, 
2.. Grade level cat-eer day. • 
' " 3,' All-school career day. 

To aXlovJr studands to e>:plore for themsslve^ occupations 
and occupational cluBtars, . \. ^ . " 

to give the students guidance that t:;lll help them age 
^^thems^lvas" In preparing for, their role in the v;orld 
ot work. 

XV» To develop in students (7-12) an awareness of the pos- 
sibilities and reqnirementis l|i making career decisions* 

SA* To* provide guidance inf0rimt ion for students giving 
* ithem the opportunity to become orientated with career 
educatloQ^aterlals, resource personnel, and serviced 
' available, x - • 

% 1. Occupational information center* 

2^ Counseling services* 
3* Comaunlty resource people available. 

B, To institute a testing program for all students helping 
them to better understand their interests, abilities, 
values, and other, self-charactef istics, 

■ ' ' • 25 
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1*-Scamin test* ~ \. - * 

... tr .Ruder* " - - ^. 

C To Produce occupational information across a wide r#nge. 
of.jXl^lusters, for all junipir high sttidents. \J 

i). To provide the 'students' with the necessary services 
and materials needed for job orientation and job^ , ^ 
Exploration grades 7 - 12. . * 

E. TO provide foy students 10 -12 ah citpl^^^^^^ 

experience education program for on-the-job ^obser • , 
- vatio? in dlffereiit occupati^^^ , 

To' provide the students with the opportunity to evol^ • 
iheir om value system f octising on the career dev^loi^j^t 
theme through interdisciplinary projects, _ _ 

A. Social Studies Home Economics^; - Yoh the consuitter*. 

B. Science ^Ecology." 
G*Social^ Studies -"Challenge." 

D* English - Busines's Education* _ 
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Ijfidependent School District #279 
Osseo^ Minnesota 



I. To develops teaching staff with a more posl^tive attit^^ 
- to^v^ard Career Edtication and the capability of shaping : . 
career oriented behaviors in stijdents. / 

1* In-service classes through University of Minnesota. 

2* Media presentation on implementation. 

3.. Resource guide , speakers and field trips. 



IX. To outline majotrcareer education objectives K-12* 

1, Develop objectives in' career education K'-3^ 4-6^^ 

2, Develop a model for implementing Un our di^ 

III. To develop a set of teaching tnaterials Consistent with:J:he 

K,-12 db jecitives thait Xvrlll help teachers--tot integrate ^ 
V career education activities into existing curricul ay 

Staff developme^ career education 

- ''^2.- Career resource room at the secondary; level . 

3 • Development of ' 'pro je c t*^ : appr da^h^jpate for career 

- education. -'-z^-v-'--''''^^^^^ ■ 

4. Screen and recommend prepared media matei\ials for / c 
purchase. . \ 

~ "^^^^ 5 Produce local media materials that will help integr£i te 
■■ > ctirriculum materials . ^:./'"Vv 

IV. To develop in students K"12 a basic knowledge o£ career 

opportunities and more* positive attitudes toward the value 
and necessit:y of work In our society.^ _ 

•1 i.. Implementation of the developed curriculum career . . 

resource center. 
V ^Fce^back from business and industry vis Itat ion by 

.students to business. , / 

y*; implement and revise our career education curr icultim 
materials. ^ * 

1. Select on a pilot basis/ schools^ grades, and/or , 
d6partments -to implement tnaterials^ - 
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2^^To^ gather base71ine~d&ta that wiil~'enaSre^sT~to 
evaXxmte and revise If necessary the^^ tnaterials 
being used. ' - ~ . . 

VI,- To improve comrAunications and cooperation between the 
school and bxisinesa^ industry^ community and parents. 

1» To develop" at least two newsletters for district 

wide circulation* " , . -'^ ^ 

2. Media presentations tp civic organizations^* 
3# Report of progress* to Board of Education. 
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. Owatonna, Minnesota 

I, To improve the attitude of educatots to^^ard career 
. development, . .- : ^ ' 

a. By providing in-service education through at least ' - 

- four tours, three" outside speakers and eight discussion. ' 
' ' . ' groups for all elementary teachers and administrators. 

b. . B y provMing an _atm e5 phGrG -^^B^^^^--4is^uss-i^?it-be tw een 

- educators and employer-employee concerning mutual 
problems and concertis during the in-service tours, and 
the discussions following the tours. 

c. By inviting young people, maybe foirmer students, employed 
and unemployed-i^ to ^meet^is ^small^gr oup Ais cus s ions with 

~r d. By creating an educational environment which will moti- 
vate teachers to develop and use career awareness * - 
materials in 'their classrooms* 

,11, To improve the attitude of the community and parents toward 
a career awareness program. 

a. By involving 25 or more bus5.n<2sse,s In -an in-servfce 
training program foif educators^ class field trips,, 
and business resource people. 

b. By making provisions for ^teachers -iuvolved J.n^Jihe.^rGgr|ra^ 
7 to epeak to civic groups, PXA., and other community groups, 

• , • to inform the community and make them ^aware of the 
^ importance of career awareness in grades K - 6. 

. c* By publication of activities carried out locally in the 
newspaper and on the^ local radio station, , 

• -- d. Develop and distribute community wide 3000 or more 

brochures describing the Ovfl'atonha Career Awareness Program 

nr. To modify the elementary school curriculum So it will include 
career awareness materials for grades K - 6 in all Owatonna ^ 
elementary s chools , public and private. , 




V awareftess materials^^ b 

respurde people, printed materials ^ games teaGher- 
: busiiiess discussion: gtoups , or purchase p£ iflatern.als 
;. developed by others. 

IV. To 4evelop V7ithin students an attitude of respectability 
; . f 6r work in all types of jobs, - 

■ 1 a. By showing a factual overview of as inany occupations 
^ as possible which are included in the 15 occxipational 
i clusters as defined by the United States Office" of 



EducatiQn at some time: during a student^^ - 6, grade"' 

. year. ,-: r.'^:.' ' . ■ • ' 

b. By modifying teacher value judgements on any occupation 
so as to not yield a negative image to any job. 
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Plaiiiviex\?5 Minnesota ; 

Winiona Area Vocational Technical Institute 
Winona, Minnesota ;* 



i • To develop an itnproved under staiiding .and attitude on the 
part of parents j teacher and coimtiun it y concerning their 
role in the career development process, ' 

^I-^— To-heip all s tu deafes— gain a-he^^r^t^erst^^ 



o\m goals, interests 5 arid ahilities irele^^^ to occupatjions> 

III*- ^ To help youtig people make realistic career choices in light 
of their special interests, aptitudes^ and potexitialitl^^ 

IV* To help students learn how to conduct a thorough investi'^ * 
gation of occxipational fields* - ^ " ■ 

• V# To develop in 'Students, parents, and teachers an improved 
mderstandtng for- the value, dignity^ atid discipline of 
work in an occupation* * - - 
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- — - - --Independent- Schoql- Bis t^^ — 
.* : »" Red Wing, Minnesota 

■ ' ' ' ' " ■ , ' , ** ■ , ■ " i .t .. ' : ■ ' 

To jbf baden each sttidcttt's knowledge of occupations, 
beginning at the priihary leveX and cpntinuing. sequentially^' j 
tbif-OUSh\ high school »' ^ "i ■■ 

A, -By identifying individual abilities, interests and" 
^ ' aptitudes,, and using them to aid tjie« student in selecting 
a suitable progtarn of Study. ' 

B* By adapting curriculum areas to include career devel- 
bpment studies, 

C. By s tiffeSsing proper v/ork attitudes in occiipational roies . 

p* By providing instructional rSaterials aenters to include ; < 
y a "Job Exploration Center" and occupaftional research 
\ materials for? student use,. . ^ ^ 



eI By- exploring all, avenues of fur tlier education. " 

. , y \ " '•' ' ■ . ' . ' ' ■ ' 

to\ provide curriculum and program which are directly 

reiated to the World of Work. ; - 

^ ' ; \ • * , , ,. , - . ; ■ , , ; ■ , ' ■ 

A, providing expanded work experiences : as planned by 
tl^e vocattohal -rehabilitation coordinator through the 
cooperative programs such as trade and industry, office 
educatioii, distributive education, and within the 

; special education classes. 

B. By using .simulated work roles t6 enrich occupatibhal 
exploration, , ^ 

Xf, By incorporating field ti^lps with a purpose, and 
initiating £oliow-up studies related to occupations* 

D., By giving each student- expos\xre to a minimum of at least 
pne job related x'esource person during the school year* 

Ei By offering senior high students an expanded choice of^ 
vocational subjects V- _ ' / 

F,^ By assessing special needs of -exceptional children to \, 
adapt a curriculum useful to them* 
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_Gv By Qr ienta ting st udents r>eg arding s pec ial Qccupa tlon al 
*^ charactex^istics of layoffs^ joblessness j termiiiations^ 

recycling J retraining and continuing education to meet 

upgraded job standards. . 

To involve the conrnilnity as a part of the total eareex* 
develo^ent program. ' , 

At By using community advisory councils ta gather inf or ^ 
mation and reports from the business atid industrial 
community, 

B# By compiling a comprehensl-ve-^coiiuuuaity^ 

■ • . ^' "■ ' ■ , ' ■ 

C# By seekD.ng wotk e:>cperiences in the community for ^^hands 
dn'^ knowledge of occTupations. \ - 

D. By planning field trips for direct contact yith many - 

By using cpmmunlty tespurce personnel tp btirtg j6b 
knowledge ixito the classroom* 

P. By establishing clo.ser contact between parents and the 
school i)y calliiTig upon them as resource persons. 

G» By seeking news media coverage to kee^ the community 
iiiformed ^bout the school career development 'program* 

To increase teacher *s Icnowledge of occupations , educational 
opportunities fot youths and of techniques for implementing 
career development* 

A. By; conducting in-service training programs to aid 
teachers by suppl>^ing id^as^ examining materials and 
techniques ♦fot career developmeitt. 

B* By examining new materials and evaluating .them for use 
,itt the classroom. ^ . 

Ct By providing teachers with information regarding 
^ otidupations and educational facilities. ^ 
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Independent School Dlstrib# #6^^.^ ^ / , 
TldseviilaT Hlnnesoe^ T"^~ ^ ~ 

To give students an opportunity to ac(:}uirS| x^espect for 
workers and the place of work in our sdcleity, 

A, Is aware of ths tneaning of work of sig,nificant persons 
, -in their lives*- •„" ' ' ' 

1. A student becomes av^are of the range and scope of 
occupations . / ' : 

_ _ 2^ -The studfent-identif ie^-^the A?a3^^^^ oh work 

and achievement of ^significant petsons in their 

■• lives, , - ' * ' - ^ ',i 

B, Identifies the contributions of a wide range of workers 
to the well being of society, j f - ■ / 

V, , . ' , , ■ t/ ■ ■ \ , ^, . ' 

1, The student becomes aware "of I ;tee intei-relatediiesis 
' of occupations and the ii- dej/^ndency on each other* 
Z* The sttidcnt understands .theme^ed for specialisation 
and diversity* of occupationM^^ individuals, 
3. Is able to understand the ittpeirtant and changing 
contribution of woman to thk world of work. 

C* Undergtatids how worlc can help/ ameliorate social problems. 

li The student understands beiing unable to woyk has 
negative effects on the whole community and society* 

2* The student understands why meaningful work gi,ves 
an individual a feeling of ''worth and gives him 
pride in himself. ^ ~ 

3, The student becemes aware of those occupations which 
help to change and improve society. 

■ ■ ■ , _ 

To develop a positive attitude toward self through an 
awareness of his developing values, talents > and interests 
as they relate to work roles,' 

A. is able to perceive and describe himself as having both 
similarities to and differences from those around about 

* ■ him, . - " . ^ , * . ' ■ , 

1, The student is able to describe specific physical 
and psychological traits of . himself as compared to 
thoste of othets. 
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2* the student is/able' to use his awareiiess of 

individual differences to enable him to v^otk vjell" 
with others. ^ , 

B» Is -aware of how his worlciTiay- be affected by his abilities, 
interests,- physical characteristics ^ md health. 

■ 1. The student is able, to use his Icnowledgti of personality 
~ traits to discover how they relate to occupations. 
2. The student is aware that his personality is constantly 
changing and will, therefore, influence his ^career 
development. 

. C, Is able to perceive and describe qualities which set 

hitn* apart as a unique individual and how these qualities 
affect -work roles. ' ' ■ • 

1* The student is able to realiisie hov? occupations would 
'provide him with an opportunity to express his 
personality ,j( creativity, needs, talents). 

2. The student is able to identify personality ti-ait« 
which are appropriate for workers in- specif iC: 

occupations. ; 

III. To make the student aware of the advantages aiid disadvan- 
tages inherent iii various careers. - , 

A* Identifies and explores broad occupational clustery. 
■ ■ . . ' ■ ■ • '^'^ ■ ■ I' ■ /" 

1. The student is able to associate jobs with the i^roper 
occupational cluster. ■ 

2. The student is able to see a coiwiionness of elements 
ill jobs that fprm clusters, 

* *' - ' ^ ' • . 

B. Is av7are of the values placed upon various occupations 

in our society, ^ ^. . 

1, The student understands that different individual 
values can be realized through differing occupations. 

2. The student understands that in our -complex society, 
all occupations contribute to the society though 
the fewards may vary. 

C. Studies workers in various occupations to become aware 
of economic, social, physical, and health implications 

• associated with various occupations. • 
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i. The student becomes aware- tbat different-^ecUfations — ^ 
require differ iiig physical, social and mental ^ ^ 

attributes. \ ^. - • 

The student becomes aware that different occupations 
have varying potential for tndivldml growth and 
change relative to his life style, 
3. EsGomeS aware that both worker and job requirements . 
- are constantly changing and that change in the 
future may be accelerated. 

To develop decision-making skills and an a\varexiess of the 
results of actlons^nd deci sions which give him a sense of 
destiny control. 

A. The student can describe the natural consequences of 
his actions. ^ - * 

1, The student realizes that every action has a ; : 
consequence whether positive or negative, 

2. The student develops a process of niaking decisions 
in which a student will weigh the possible conse- 
quences of an action, ' 

B, Be able to describe how his life's work provides 
oppoi^tunities for changing his status and environment. 

1. The student realizes that various jobs have differing 
capacities to meet an individual need. 

2. The student realizes that: changes in status and 
environment can occur x-7tthin an individual's career. 

3. The studeiit realizes that ttfiantici pat ed events 
Ceoonomic, social, health, etc^) may influence 
career decisions and plans, * 

C 'To realize an occupattoii is one of the ways an individual 
can achieve self -fulfillment, ^ * - 

1, The student realizes the individual's career needs 
for self-fulfillment vary. 

2. The stxldent understands the ways in' which self - 
fulfilment needs may be satisfied by jobs. 

;d* Exhibits planf utiles s in the way he manages his resources 
to achieve individual goals* 

1, The student rcaKzes to what degree he can utilize 
resources to achieve more time for individual 
pursuits. . 
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plans the best use of his resources, 
'is. The student understands the sequential nature of 
decia^ons inhis career plans, 

-To develop interpersonal skills re^iuired in work rolesv 

A. Cait identify the talents of an individual in a t^ork 
group which allows that individual to function as a 
contributing member, 

1 . Th^ s^^1r^e■■^^^ w-ll 1 MtMi.yf. ■nftCAfi.g .nr y skills to be- 

come a contributing member of the work group. 

2. ' The student can apply his talents and skills in 

work situations. ' \ 

B. Understands that most job roles involve teariMork and 

a willingness to cooperate -and to get along with others, 

1. I'he student becomes aware that each person in an 
interpersonal situation must satisfy his job role 
in order that . the group might function. 

2, The student becomes aware that the nature of v?ork - 
demands that each v/orker give up some individuality* 

- Z^, The student becomes avjare that certaitt jobs prdvide 
a greater opportunity for individual expression. 

C. 'shows cdncern for fellow workers gnd shares in tfS^ 
•success or failure of 'the group V70rk 'projects, 

1. The student is able to put group work «goals 
primary to individual goals,. 
' 2. The student becomes aware that in the world of 
work 'group success or failure is" dependent upoii 
the cumulative effort of the group.. 
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WillTnar-, Miiinesota iti eonjuction x^itlr the 
Willraar /^tea - Vocat ipnal-Teehriical Ins titiite 



Curriculum Task Force 

A. To correlate and record the community reiBuirc^^^^^^ 
the existing curriculum where thfiy ate most useful, 

1. The Curriculum Task Force shall develop a Resource 
Guide and assemble it , In booklet formV 



Teacher Training 

A. K training program .emphasizing carefei^ development will 
be developed for teachers K— 12. 

- 1. A training program -for lay^pgopl^^^^^^^ j 
presentation of -mater 3.als will be developed, - y 

Community Resource Assessment 

A.. A Community Res otli^ce Task Force will develop a list 
of businesses, industries and .service agencies to be 
interviewed in regard to sharing information about 
their professions x^ith school students. 

1. Members of the task force wili"lnterviet^ members of 
businesses, industries, and service agencies. 

2. The Community Resource Task Force shall classify all 
community resources by occupation. 

3. The task force sha;ll assemble a bt^oklet of community 
resources ayallable to the public schools. 
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White Bear Lake, Minnesota 



i. Record, evalmte. and gather data related to what we. 

• are presently, doing in aU-stibject areas.for career ^ 
.V'^^- development r ^ ' "pr-^ ^, ' 

il.. implement existing curriculum "laterial lathered 

througtioufc-the countiry into as many_ .subject areas of .the 
curriculum as possible on an experime;atal basis. 



III. Provide materials, commity te^ourc^r and related^^^ 
visual aids necessary to implement career development 



units* . 



W Provide an exposure to a numbei- o£ occupation-related 
- speake^^: student visits, and limited, exploratory on- 
the- job experiences. - ' V 

V. Provide in-service training for our staff outside of 
school hours. 



VI Develop a fcompr(Shensive commi3nity occypational speaker 
resource list utilizing tab equipment and school census. 

VII. peveiop a limited on-the-job experience program for ^ 
• • selected students, ^. 

VIII, Utilize community business and industry for observation 
and visit by , both students and teachers* , - . 

IX. .Utilize a steerii^g. committee r^^^^^^ f^^'^^'ir^ef " 

" educators, and community in all phases of the ^project, 

X. .Evaluate the program based on performance objectives to 
be developed in .the early stages of -the project in 
addition to evaluation based on selected base-lxne data 
information, ^ , . „ 

XI. AS a resuir of ' this .Dmject, the students participating 
will begin to have: " 

(1) The Ca reer Develowent Program , Tennyson and Plorencc 
' Hanson, University- oi Minnesota, October, 1970. 



\ 



" i7"A"cIarif i"<^^^ self^concept telateid to occupj^tidris 

* and work," ... , 

2. The ability to- assume responsibility for v^ocational 
planning, , . . - % 

.32- Tli4 abiiity to identify their personal ne<=«4s and. 
sour ces, of satisfaction which shoiild' be considered' 
in planning a career. , ' 

4. A knowledge of occupations and t^Ork situations.. 

• 5, A knowledge of vocational education and resources, 

' ' , * "' ... . ■ * ' " ■ ' • 

6 , An ay?areness' of the decision making processes — ^— - 

7, A seiise of independence. " " J 

XII. Gooperating teachers will: - 

* 1, Integrate career concepts into existing curriculujiij . 

2. Cooperate witH-and utilize conniunity resources, 

3. Provide leadership in developing, the career concept 
' with other members of the staff j» 

4. t?ork cooperatively with the guidance staff in fche 
development and use •■of career educational material.s 
and concepts, • - 

.5. Continue to develop the career concept in their 
curriculum, 

Xill.^ The participating community resources wlilr 

1, Become Ttiore involved in providing speakers, work 

laboratories," apd . the in-^servicing of teachers through 
•faculty visitations, 

ti Play more of a role in assuming respdnfribtlities for 
related. career exploration of students not possible in 
the school setting. 
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3« OvfATONNA , 
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5." Red King 
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' 8',' White Bear 
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MINt^ESOTA 

• EXEtfl?LARY PROJECTS IM C/JREER EDUCATION 

Funded Under Section 131(a) of Part C of the 
Vocational Education Amendments of 1968 
(Public Lm 90-576), for FY 1973 _ 




^^OJEGT TITLE 



A comprehensive 
Exemplary Program 
•'Orientation to 
the World of Work 
(Career Develop- 
ment IC-12> 



:0' 



Project TACO: 
•rechnQlQgy As *- 
sis ted Career 
Orientation - 



Independent School 
District #94 -^ 
Cloquet,' Minne.^ota 



Independent School 
District #279 
OsSeoj Minnesota- 



ERIC 



DESCRIPTION^ OF LOCAL PROJECTS 



A comprehensive career education 
program has been devel oped aiid , , ; f 
implemented at Cloquet \7ith the 
assistance of community resource / 
people. It is aimed at pro|^iding 
all students throughout their ^ . ^; 
entire educational experience (IC-l 2) 
a series of related, comprehensive, 
systematically planned career 
educational activities . Emphasis 
on self-concept and attitude 
development of -the student v7ill 
continue" at the elementary le\*el, 
with an' interdisciplinary approach 
and exploratory work experience - 
programs utilized' at the junior 
and senior high- school levels . r 
respectively. Performance con- 
tracting has been used as one means 
of developing and testing curric- 
uluni materials and encouraging 
staff involvement in -the project. . 



Three goal s , summarized as Aware- 
ness, Appreciation and Attitude, 
and Decision Making, form the basis 
for a comprehensive career educa- 
tion project for one of the 
smaller suburban school systems in 
the .metropolitan area. The pro- 
ject is being conducted on. a pilot 
basis in the district with four , 
■ ciementary- .febhodls , , three jtB^ior- . : 
high schools and the counseling 
and guidance departments in the 



jj^^..iipliiry Projects in Career Education 



mo JECT TITLE 



Project mCO: 

eantinued-,; ^ . 



career Awareness 
Kducatioii ; " 



0 



S tudent s , Parents 
m6 Teachers Ex- 
plore the World 
u£ Work in South- 
ea«tem Minnesota 



% 



FRir 



SPONSOPaNG SCHOOL(S) 



Independ ent S chool 
Mstribt #761 
Qwatonhaj Minnesota 



Independent School 
District #810, 
Plainview, Minnesota 
and WinonaT AVTI 
Winona, Minnesota 



DESCRIPTION OF LOCAL PROJECTS 



senior high schools, involved, ' 
Objectives have been developed, 
and activities initiated which 
consider the needs of students, 
teachers, and the community. 



The career education project at 
Owatonna includes staff and stu- 
dents from both public and 
parochial el^Smentary s chools . All' 
stud&iits^axid - si:af £ at this level 
are currently involved. Consider- 
able effort has gone into the 
.development of curriculuiu materials 
x<rith a view to iiitegi-ating career 
information into the pngolng 
curriculum. The goals of this 
project are: (1) to modify the 
^t itudes of - educators toward 
career development , (2 ) ' to change 
the attitude of the coniiriuiiity to- 
ward a career avmreness program> 



to integrate career awareness 



(3) 

rnaterials into the elementary 
curriculiom, and (4) to develop in 
students a positive attitude for 
all types of jobs. 



Plainview has used a two phase 
procedure in implementing career 
education in its school system. 
The project started in its initial 
phase at the elementary level* K-6, 
with an upward progression into 
grades 7-9 in the succeeding phase. 
All learning experiences at bolih- 
Icvels are integrated into the, 
existing curriculum* Games /de- 
monstrations, skits > role playihg 
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l^ROJECt TITLE 



SEONSORIKO SCH0OL(S ) 



DESCRIPTION OF LOCAL PROJECTS 



Stiicteiits, Parents 
jimr Teachers Ex- 

poi-eVtHe wotta 

oC t^ork in South- 
<rastern Minnesota 
contintied 



Cai^eer Oriented 
k<}tipation in the 
l;c*d tJing PubLic 



independent Scliool 

mstrict #256 

Red Wing j Minnesota 
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and audio-yisual materials are used 
in the classroom in teaching about 
the World of V7ork, while field 
trips J re s oUrce pe opl e and indivi - 
dual and group projects are modes 
of instruction used outside the 
classroom* In addition to 3-earning 
about the World of Work, emphasis 
will be giveia to teaching students 
about hobbies and leisure time 
activities:* ' ' . • 



The /Red Wing project 'was designed 
*to culminate in an' articulated, 
comprehensive (k^-12) career educa-- 
tion progi'am to fee conducted in -v 
six elementary sdhool Si a junior 
high school and a senior high 
school. Prineipals of the ele-* 
meilttar;y'' schools will aid in orienta- 
tion of teachers in VJorld of VJOrk 
concepts* Each building principal 
will aid teachers in planning, _ 
promoting, and establishing career '* 
education projects within the 
class-rooms, build iiig, and the , 
comi-nunity. At theielemenfeary level 
there is a strong emphasis for parent 
to be called uispn to serve as re- 
source persons. Exploratory 
experiences at the junior high school 
have been included. as specific 
units and pro jetits within subject 
matter claA,ses. These will be 
expanded during the year with 
increasing activity from the vat' ions 
departments * Likewise, at the 
senior high school level pro jects 
have^ . been 'initiated in varic'us 
subject matter fields* In addition, 
provisions for work experience and > 
student job placement services are 
teing developed* = * , , . 
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dPROJiSe-t TITLE 



SPONSORmG SCHpOL(S) 



DESCRIPTION OF LOCAL PROJECTS 



Daveioptnentai 

ment Elcnientary 
Pi-ogram for ' 
Independent Schoo 
mstrict #623 



independent School - 
Ros eville J Minnesota 



ibe Eclevatice of 
CC'St'munlty Re- 
nom'CGs TovTard 
tim Dsvelopraent o| 
t'vider standing ,; 
0e<^?upatioi'iai 
CJ^fportnnities and 
lite Significance ; 
t; C the World of 
vJ^rk in the 
Ulltor Public 



Independent School 
mstrict #347 
WillViaf , MlnnpS ota 
Willmar Area Voca- 
tional-Technical 
Institute 
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The career education pi-oject a£ 
Jlosevlllia Is focus itig on the elemfxi- 
tary level/ Its_ purpose is to 
develop and test effective methods 
for teaching occupational atrare- 
ness in the context of- a large 
urban elementary school system. 
As suoh^ the project has e:^p£mded 
horizontally from Its pilot phase 
to include numerous schools ^ 
teachers j students;, and' counselors 
at the elemantary level* Consid- 
erable 6mphasia has been given, 
at this site, to the evalt:»ation 
component of the project ♦ 



The development of an articulated 
comprehensive careei* education 
program for a predominantly rural 
conmiunlty represents the thrust 
of the project at VJillmar-. The 
project has progressed through a 
series of phases, involving the 
elementary , junior j, and seViior 
high schools • Major emphasis has 
been placed upon idexifcifylng and 
using comniunity resources in the 
instructional process Most of 
the project focus be acconi^ 

plished through the existing 
curriculum as correlated to the 
identified resources of th6 com- 
munity. Separate career guidance 
activities are also an integral 
part of the project* 
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PROJECT TITLE 



/v Career BeveXop- 
ment I'r^ram, 

^TiMcIes 7-9, for 
i'ndcp^nderifc Schoo: 
piseriGt #624 



SPGHS GRIKG SCHOOL (is ) 



Independent School 
District #624 
White Bear Lake 5. 
Minnesota , ' 



DESCRIPTION OJ" LOCAL PROJECTS 



White Bear Lake is a recent addi-* 
tion to the career education 
exemplary -pro jecty having* heen— 
chosea as a replacemsnt site for 
anotfter suburban school. The 
focus at this site'V7ill be on 
the junior high school level (7-9) 
with two public schools and one . 
parochial soigol involved. The 
project V7ill utilizi;^ perfornmnce 
contracting and beg'^n with "already 
developed'.' curriculum mtex-iaXs 
procured from throughout the v 
nation. 
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cioquet 

The Garfield Gazette - A Magazine by Garfield Kids . 

Career Developnient Units for Practical Math Students in Grades 

10-11-^12,- ^ - 
Career Development Curriculum Project - Slide Series - Office 

Procedures and Booldceeping Classes* 
Studying Spaceship- Earth - Summer School Course. 
El^Mntaty Career Development ^ Parent Visitation Programs - 

by Video-taping. . ' 



Osseo ■ . 

Directory of Resources. , • 

District No. 279 Educator, Special edition, Career Orientation 

program. * . * 

Curriculum •^instruction I-Iaterials 

Genetics V " 

Applied Physics 

Astronomy , , • 

English CurricuUim 
A Net^spaper Unit Utilizing Career Education - Pour.th Grade 

. language Arts. 
A Political Science and U. S. Government Unit Utilizing 

Career Education - l*ourth Grade Social Studies. 
An Insect Unit Utilizing Career Education - Fourth Grade Science, 

Wood\^orking Unit - Grades 4>-6 . . - - - - ■ - 

Using Media * A Curriculum ^od e l f or -^^egra^iftg-Gareer— 

Awareness and' Subject Matter. 

' ■ . . - ... . ^ ' . V ■ ^ ^ ■ 

pwatonna , .. ^ ' 

Owatonna. Career Guide ^ Gi*ades 1-6. 

(Tlxis guide was selected, for r?.production and distribution 
to ail elementary schools in the state by the Pupil 
Personnel Services Section, Division of Instruction, 
Minnesota Department of Education.) 



Plainview • • .. 

Career Education Games Plainview' Elementary ichool. 
Expanded Education, Phase XI - World of Work, PlainvieW Jr. 



Red Wing . - . . , 

Red Wins Conimmity Resource Guide. . ^ _ ^ 

Red wSi career -Educ^ition - instrtictionat-tlaterialB, 
Guide . . 



RosGville 



Roseville Area Schools - Career Development. 
Rosevllle Area Schools Occupational Educatxon - Career 

Development Kex-js Letter. - . 

Career Development K-6 Resource Materials. - 
Roseville Area Schools Career Educatien Sera.es . 



White Bear Lake 

Career Development Social Studies, Grade Nine. 

Exploration of Careers in Communit;/. . - , 

Development of Career Education Center. 

By the Sweat of Your Br ov?.* ' / - 
Occupational Cdmputer. System Adapted for' Science. ^ ^ 

SWAP Study Work Advisor Program Handbook for the Project. 
' DlTfector, Sponsor, Employer^ parent or Guard xaii. 

career Educatioii Resoui^ce Center. tii«-5nr mr4i 

SWAP StudyW^Drk Advi&oir-Program Handbook for the Juni^or High 

^^"Studentv" ""^^ — - ^ - ; ^ 

Community based Speaker's Program. 
MAC - Music and careers. 



Willmar 



A curriculum Guide to the World of Work Occupational Survey'. 
Willmar's World of, Work Project, Dissemination, Lxplaiiation 
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SECTION 1. INTROOUCTiON /WD HETH 

The major goal of this study was to research and evaluate the feasibility 
of the career education modei being employed by the Minnesota State Department of 
Education, Dtvfslon of Vocationat-TechnicaT Education, this final report Is one 
of 'two repoi^s which were prepared as a third'-party evaluation of the projects 
The specific objectives of the overall study were; 

A. T o evaluate the ef f ectiv e ness of both th e project's a dmin tstratfonp-^™^ 
and the career education program as 1% Is operated in the schools; 

B. To identify the products and processes of the eight sites which 
my be transportable to the other LEA's within the state of 
Minnesota and/or the nation; 

C. To project the cost-benefit relationships of transportable elements, \ 
bath those elements uni<jue to the individual sites and those elements 
common to the entire model; 

D. To develop descriptive profiles of the students served by each of V 
the eight sites, including number In each project, grade level 
and other demographic and educational characteristics which might 
enhance understanding of the transportable elements; 

E. To determine the disadvantages and advantages of an eight-site 
model to a one-site model. Since the model utilized by the state 
has eight sites, this objective will focus mainly upon the 
feasibility and efficiency of this eight-site operation. Under 
these conditions. It will be impossible to make a direct comparison 
of an elght*slte model Versus a one-site model* 
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F» To conduct an auditing process of the invoWement of the ItCU 
with the models. 

This final report also includes data and observations presented tn the tntertffl 
report of May 1973. 
1,1 Philosophy 

Hethodoiogy of evaluation Is directly dependent upon philosophy. To 
better uiidcrstand this eveluatioti effort; one should understdnd ft* phMosophfc^l 

concept statement: 

Career education, i^ccordfng to the various dtscu$stons and 
position papers represents a comprehensive rei^ocusing of the entire 
educational process in the hope of Improving a variety of societal, 
* etonotni C and personal outcomes. Th i s ref ocus t ng of educat i cnal ^ 
r processes Is a shift from the ylcarlous **teachrng abouV^ condMcted 
Wtthin the typical classroom situation to an experiential fusion 
with, and Mnkege between, the academfc, vocational, and avocatlona^^^^^ 
Worlds* It Is anticipated th^t, beyond t^^^ 

at the elementary schoql level, additional formal instruction wllv 
becbfvie more rcsponsfve to the Individual self perceived areas of 
weakness as he inte/rt-ts with the br^d society and will be relevant 
for the learner's total 1 1fe experience. The counsel Jng process^ts 
to serve as tha point for coordinating these muUiple activities 
and as an aid to the student in processing Informational and exper- 
ten tlai input* 

Despite - or perhaps heca 
of this concept, the exar*- dimensions for planning ^^a^ implemertta- 
tton are presontly In a w^-itlnuing state of evolution^ the broad 
aim of carcof cd!«r.^t ton seems to be to increase the capacity for 
informed dcclsion-inskeup by every individual regarding his personal 
and career diDtces during the course of his entire life span. The 
Justification for such an extensive re-tooMng within many of oaf 
spcletcr fr-iftl?:u^^ In the growing awareness that out* 
■ 'current $yste:n;?^f2i fallln^^^ the popu* 
latlon. This f^^lTi^re Is particularly evident for those 
' previously had limited access to meaningful participation In 
^ deciston*-mdklng wi thtn the system and those who have been channeled 
Into an unreel Istically narrow preparation for a specific vocation. 
— — Im^l lclt^/, thi^-ti*end-seeks tc-afford t^ 



recognltlori of His own skills and tatentsi and of unexplored options 
relating to career^holces* Attainment of thes^ subsidiary goals Is , 
• « neeessary corollary t<i. the realization of true equal employment 

opportunity. Meverthelcss, career education iiwst Incorporate the cpVlege* 
bound lis tudent, as we VI as those now en n>l led within the general educa- 
' tlon and conmierclal tracks at the seccmdary level/ In order to avo^^^^^ 
itigmat Iz I ng the program as a new mea 
segments, of society. 

*• One desired rctsult of litiplenientlng a career education program : 

would to install greater continuity between the roles prescribed - 
for the children and a^^ 

tootety, easing the transition from the somewhat passive 

status assigned to childhood and the abruptly disjunctive expecta- 

t|j«s^jbsy„fQ!^^^^^^ aftd self-sufficient. SIhCe 

career education has rami treat ions upon trie entire community stTirc- v 

tiire. It would appear essential to Irtitlate some formal method f or - 

Inobrporatlng and benefiting from community opinio 

Ii2 Conceptualization of the Minnesota Model 

th» Minnesota State Department of Vocationa 1- technical Education has funded 
eight exemplary career educsttlon prbjects throughout: the state of Minnesota. 
With one «iXception, all projects haye been active since the beginning of the 
1971-72 school .year. The cbnceptuaUzatlon of the Minnesota model Is presented 
In Figure 1,1* At the center of the model Is the State Department, Division of 
Vbcatlona? -Technical Education, (DVTE), which Is responsible for the admlnlstratloii 
of the projects, and the Research Coordinating Unit of the University of Mlnnesoti, 
which Is responsible for tlia Internol evaluation. These two agencies work very 
closely In relating to the eight delivery sites, the sites may be generally 
classified Into the throe following cr»tc3Qrle$: ^ 

1.2.1 Sub urban Communities ; These communities are In close proximity 
to the twin Cities Metropolitan area and may be thought of as "typical" metro- 
politan Suburban area*. Included are the sites of Osseo, RbsevI lie and White 



Bear Ut<e» The school districts and the communities, are the largest of the eight 
project sites. Each, of the three dlstrlcts^^^^^^ In tjxceSs of 10*000 students . 
In grades K«-12 with Osseo being the largest of the districts *at about l4,0fDO 

students. ' • ■ ■ ■ , ' ■ ' •• 

l.2*1 4^dus t r I a l-Ag r I cU 1 1 u ra 1 Ccmmun 1 1 1 es ; The communities which are 
termed Industrial-Agriculture are generally smaller than the suburban group, are 
located out-state, away from the general Influence of the metropol Itan area, have 
n esxa mM^'^'*^^ Industrial and service ceyers within the 

communities and are surrounded by agricultural areas which also contribute sub- 
stantially to the community's economy, these communities are Cloquet, Owatonna, 
Red Wing and Wlllmar. The school districts of these communities range In size 
from about 3.500 to ^,500 students* 

1.2.3 Agricultural Community ; The third type of site Included In the 
Minnesota model Is characterized by being smaller In population than any of the - : 
other -communities and hos Its economy primarily dependent upon the agricultural 
surrounding areas. The site characterizing this classification .Is located at 
PUInvlew, and that district has ah enrollment of slightly over 1 ,000 students In 

grades K*I2* - _ 

1.3 General Contextual Factors of the Communities 

Each of the three types- of con^tiunlttes, ifcwell as the communities themselves, 
offers unique aspects to the development of a'career education model.. The first 
type of community, suburban, contains large school districts offering a greater 
variety of Servlcos to their students and, consequently, employing more specialist*. 
The suburban sites would have Immediate access to almost all of the occupational 



that are typically found In a large metropolitan area. They would not, however, 
hive Iromedrate access to some of the agrlculturat occupations which may be found ^ 

th smaller communities. 

The second group,., the Industrial-agricultural communities, would have 
|nn>edtate access to both Industrial and agr I cultural employment (although hot as 
extensive Industrial diversity's the suburban projects> situations h^rmally found 
in cor«nunItles of medium size with self-sustaining Industry surrounded by agricul- 
ture. Found here are many of the same kinds of Industries as located In the metro« 

agricultural] while there Is a lessening of suburban and/or r^tropolltan-lnfluences. 

The final community. Ptalnvlew, would have much cif Its Immediate employment , 
possibilities related to the agricultural environment surrounding the commurvlty. 
The l««.dlate employn^nt areas would differ significantly from that of the s^rban 
cc^unltles. Likewise, levels of In c<^ and other social economic factors would j 
differ from the patterns Of the suburban or the Industrial-agricultural co.m.nltles. 

These communities typify the general posslbl lltles which might be found In 
a state such as Minnesota; namely, a large metropolitan area, an out-state area 
- of smaller cor«.unltles, but co-unltles based both upon Industrial and agrlculf^al 
«C<«^les, and the rural communities based primarily upon an agricultural economy. 
1,4 Process of Data Collection . 

TO ».th.r data for this report, s.veral actlv.tl.s war. undertake.. T«o .It. 
vU.ts wore mde to «ch of th. project locatFons during which tl«e evaluation 
p.r.onn.1 «t w.th th. .uper.nt.„d«,t or h.s r^pr«e,tat.v.. th,. project director, 
the principal and a Wnlw. of eight teachers who h^been selected at random. 
Th... v i sits were conducteJ T.rdwa»^n.^^r^h^.n.^^ th^W ^Hool V'^r. _ 
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Selected meetings of the State Department officials and project directors 

•' . , ' ' , ■ . ' ■ 

Were attended by the evaluators to gain a perspective of the operational design 

' ' ,. ■ ' ■ ' . ■ 

tnd iiKkllflcatlon* of the eight sites, . Additional ly* the proposal submitted by 
•adi site was reviewed and critiqued In an effort to Identify dlscrep4inctes 
bet^Nieen the deslgh^^^a^^^ Im^lementatibn,^ Meetings were also held With DK» 
Brandon Smith of the Research Coordination Unit (RCU) at the University of JHlnne* 
iota. These meetings focused primarily upon the efforts of the RCU In develop- 
fltent and Irnpl ementa t lon of e valu ation effo rts. Reports, vprocedures and Instru* 
mentation generated by the. RCU was reviewed. 
1»5 Areas of Investigation 

Evaluation of the "Miynesota Model*' was undertaken by examining the process 
and products of the elghjC delivery sites, the RCU and the Division of Vocational*' 
Technical Education (OVTE) In eight areas. These eight areas encompass the objec 
tlves of this study as well as the three main component parties. Each area 
should be applicable to each of the eight delivery sites but not necessarily 
applicable to the RCU and DVTE as their functions are more specialized* EmpJiasIs 
among the areas also varied* 

Figure 1.2 shows the conceptual design of this evaluation^ strategy and the 

rdSponslblllty of each component party.\ As stated above, the evaluation strategy 

was to Investigate the adtlvjjies of the three component parties^ (LEA*s» RCU, 

DVTE) in each 6f eight areas. These areas wer«s 

1. Design - initial project design, modifications to that design 

and the degree to wblch the design, original or modified was 
and Is being followed and the procedures utilized by the DVTE 
In selection and monitoring of projects. 
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2,. Context * The contextual environment of the model (the eight delivery 
sites, the RCU and the DVTE) and Its relationship to that environ- 

3. Manageinint - Organizational structure, planning and Implementa- 
tlon bbth at the state and local level • 

4, Instriictlon - the plans and ImplementAtlon str'ategles used In 

, -. 1. _ ' 

the ilellvery system of Information to students as well as Inr 

^■^'7' ' I'- ■ ■ : ■ : ■ ■ : 



. 5. infoiroaBoo - Dissemination of Infotma 

inonltorlngjof Internal tjata^ j 
6, Costs - Fiscal management systems and projected cost analysts. 
^ 7» Evaluation - Third party review of the In ternM eyal"^^ 

of product and processes of the model, . 
•84 Oocumentatlon and Transportability - Commitment /of the model's 
- / processes and products to a form which can be hilstortcally pre- 

■ served. ■ .■ 

- R>r each of these areds, each of the three' component parties has c<5r^atnvres|iort$lr 
Uritlcsit. The^scale of|^csjecinsita»!lty- that was perceived by the EMS evaluation 
team after observation and discussion with the parties Is given In figure 1.2. 
For example, the LEA's had major responsibility In develop I ng a project design, 
these designs were then submitted to the DVTE, which reviewed and awarded funds.. 
Generally the UA'S are perceived as having major responsibilities as it l-elates 
to six of the eight areas. On the other hand, the RCU assumed major response 
bUttv for only one area, that of Internal evaluation. £ach of these areas will 
be discussed in detail In the next section. ' « 
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SECTION II. EVALUATION RESULTS 

. , - , ■ " ■ * ■ - , ■■■ 

Section n of this report presents the results of the evaluation by each 

of eight topic dreas. Some of the results are based upon data In other reports, 

especially by the RCU and that data Is not reproduced In this dojoni^rit^* 

2,1 Project Pes I gn •• _Goa Is . Ob J ect 1 ves . Rev lew and Hon 1 tor I ng 

It should heirecogtvfz^sd that many times J^he stated.objeet I v-es. embodied 

l# | ih l F^a~profosar ye jot entl r eTy^ppmprlate-once thr project 



Implewientatlon |r becom^ operational. On the other hand, Jn the Interest of 
"accountablltty", a project has a responsibility to conceptualize Its reason for 
being and attempt to achieve Its stated objectives. The design of each of the 
/ eight exemplary programs should and did have the cooperative efforts of the LEA 

and DVTE. The statd plan for vocational education specifies the following tor 
exemplary projects in terms of form and content of proposals . 

1, AH solicited and unsol ic\ted applications shall descrlbei 

■ a) Purpose , ^ 

b) Use to be made of results 
x) Nature and/or plan of project 

d) Time schedule and duration 

e) duallflcatlon of personnel 

f) Available facilities 

g; Budget, by fiscal ye^r. I eating proportion of cost to 
be borne by applicant 
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2# Proposals shall be reviewed In terms oft . 

a) Meeting student neejls . 

b) Reducing unertiploymerrt \ 

c) Cooperation between schools aiid manpowet^ agcincles 

d) Relevance to long-range planning 

e) Adequacy of pefsontiel and facilities 

f) Costs 

In review of the pr-oposats submitted, they generally followed the outline of 
(l) above and at I proposals were found to contain the elements specified In (l) 
abovfti^'^ this respect the format Of proposal desfgn conformed to the specif Ic 

Mellnes as specified In the state plan. The Individual project proposals ^ 
tended to emphasize certain areas of (1) above to greater or lesser degrees. 

Since the projects were funded prior to the time of Involvement by EMS 
no direct observation of the review process could be conducted. In this respeet, 
only the following general statement Is made. In review of the proposals an 
evaluation criteria should be established by the DVTE and made known to the 
applicants prior to submission. This might Include a "weighting" system applied 
to the areas of review. U should be noted that some applicants (districts) 
will be Inherently different on some of the criteria of (2) above and special 
consideration may have to be given by the DVTE. For example larger school districts 
generally have more specialized personnel and facMltles than do smaller districts, 
the criteria associated with adequacy of personnel and facilities should not be 
such as to wo'"l< to the disadvantage of an Inherently different applicant and 
there was no evidence that such was the case for the current projects. 
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th« general design of the Minnesota Model Includes; eight LEA's. An altern- 
«tlve model could Mve been to award all the funds to one 1EA» This approach 
■%% vl«iwe4 by EMS, would have necessarily meant the Involvement of a single, large 
LEA. In vtewing Minnesota It must be recalled that the state has about 'iSO 
school districts. Although a majority of the state ^& stu|ients:*^^ found In a 
minority of the districts, It Is not necessarily^^ t the needs addressed 

in that State* plan are centered In any one or any group of schools. Ih review 
of the portion of the state plart that addresses exetepl^ry projects, no part of 
that plan with the possible exception of adequacy of facilities and personnel; 
would favor a one site versus an eight site model. However, there appears to. 
be nothing In th^g^ate plan which would necessarily Indicate that a multiple 
site model shoulti be selected either. In review It app^ears that all aspects of 
the state plan were given consideration In arriving at the general design and 
selection of the eight site model. 

the reaction to the eight site model by LEA personnel was positive. Super- " 
Intendents, project directors and teachers who were lnterVlew2>is$^neraMy stressed 
the imjpOrtance'ioirthe eight slte.modei. The move toward regional Ism was cited 
as one advantage of the approach where programs can be deslgnejd to fit the needs 
of communities In a given area^ Propinquity; of course, wSs another advantagct 
especially from the viewpoint of out-state projectyersonnel. They felt that \ 
being close to the project was of great value to the surrounding schools, as 
well as for themselves. 

>^*"irhe eight site approach has the" advantage of Involving more people directly 
in career educa,t Ion, according to the people Interviewed. In this way, It gives 
teacher,s a feeling of having a part In the development of the project. The 
teachers involved will then Impress upon their colleagues the lmf)C»rtance of 
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«r«r .WOO. Th. .v..u,t.cn t«« b,r,.v.s th,t thU d>d. .na..a,'pl.y .n _ 
,^rt„, port, .t .PPTent that t«ch.« who- ha- d.r.ct.y Involvd 
,r .«n indirectly involved, possibly through In-service training. «.« ^r. 
.^CUd^able of career concepts, appeared »re Interested In career education 
„d were «.r. directly apply.n, .the concept, laid d«n In the project proposal 

thw teachers 

other advantag^ cited wer. the "h»«nUlng" effect of seller, ™ore 

4,v.r« projects, less bureaucratic pressure and the flexibility In adjustin, the 

^progr.- a. tl^e progressed to »,et the changing needs of the co™«n,ty. , 

..theonaslte^delsln^eno direct ca^.rlson-s^,»«.-^J^^ 
.cc.pt.ce hy personnel of , multiple site design „a,,.ch high. tH- 
ZL^.^ . single site. It^shou.d be noted that the one s.te^del can^^ 

: :L as having advantages^-- ^''^'^"^ 

. J irtt«f«red would be Viewed «s an advantage* ^ 
«* frh^ orolect wreeffljdently administered, wouia ^ 

,f the prcUact we ^ ^ ,He Wlon of materials coordinated^ 

th« focusing of Resources at one site ana tnc 

the focusing o j \,„„.her Many of the advantages cited 

.ioseW with program developments may be another. Many o |^ 

closely wUh . ^^^^ ^^^^ construed to be an advantage 

by the meiTfcers of the eight site mo /:.«i.„Iew Is 

offered by a one .Ue n^deV. However, If the sample of per.onnca^nte.vlew Is 
offered by a on ^ ^ ^^^^^ 

. valid re..es.ta - t^^^.^^ ^ ^ ^^ ^^^ 

♦difeotltnal community of an ejght site moaei 

acceptance of a one site model. . 
" ~ M stated previously the goals and objectives specified In the proposals. 
' not necessarrly be those In practice. Without belaboring th. point. It 

i.,d b. noted that ™o.t of the proposal, contain goi. statements rather than 
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performance object I ves. All the projects stated goals in the area of improving^ 
students* attitudes and knowlyetlg^^bout the world of work, ! r^^* 5.f{^ 
, ♦ ^ to provide students wi th a ba^sic orientation and understanding of 
the world of work. 

. » . To develop an attitude of respectability and dignity of work in all 
types of jobs, 

. , . Design a career decision-making model that will be prnf^loyed to help 
students ident-ify their individijflgf^ah^ interest^ -^l^d aptitudes 

and match them with the requisites needed for different occupations. 

the$e types%of goals Cobjectives) are found fn all proposals and are 
currently stated by both administration and teachers at all of the eight delivery 
sltes^ From observation it was evident to the evaluation team that these types 
of goats were and are a central theme in each of the delivery sites^ 

A greater emphasis, at least .in;^mber^ is placed upon process centered! 
goals. These types of goals fnclude the development of in-servlce, curriculum 
materials and career fnformatton centers such as: 

, . . to plan units of instruction that will include career information 

as part of the cburse work for elementary and high school students. 
. • • To provide in-service education for teachers in the jijirea of career 

.;• education, ■ . ■ . ^ : 

« • V To establish career education Centers in conjunction with departmental 
Informatffonresdurce centers, . 
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Soin0 6f th^se been completed, others deferred, others are In 

l^rocess or have been discontinued altogether. Iii^general , from examination of 
project's jfiropbsed goals versus what goals are being currently pursped, 
general :^greement was fd between so-*called product goafs but some discre- 
pancies wer^^^^^ the process goals, Is discrepancy should not, however, 
be Interpreted es a negati^ but rather as simply a difference between 
actual practice and proposed practice. In this respect, the evaluation team 
recoiwnends that projects review each of their goals to determine which. In their 
dptniion, fiavfi^been implemented and what degree of success has been achieved, 
tn this manner a pattern of evolution of the projects could be documented* 
this effort should be made with Its Intent being one of increasing the knowledge 
about project evolution rather than an evrfluatlon/accbuntablllty mechanism* 

in summary, the Initial design of the ''Minnesota Model" followed the 
procedures anyd^cpnd It Ipns set forth In the state plan. The goals and objectives 
specified In t^ife or I glnal proposals are generally s^tlll applicable and-being 
pursued by the LEA*s, The design of the entire model initially and currently 
continues to adhere to governing specifications, 

2r2 Contextual Analysis J 

The*speclfic process of contextual analysis can be examined In four 
stagesTv^ 1) initial conceptualization of the model itself as one manifestation 
of the philosophy of career education; 2) stated project goals and objectives 
derived from the Initial conceptualization of that model; 3) specific "forms" 
first assumed as the goals and objectives were Jihplemented by the proj^ct|^ 
and 4) the continuing change and development experiences through Implementation 
of goals and object Ives ^ together with the operational form as a project 
functions over time. 
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If one considers that each of the eight si te:» could have potentially 
conceived a model program much different from eac^;» other, one could then 
poi^slbty explain this in terms of the t>a sic difference in the communities as 
noted in Section I of this report* Moweverf it Is the impression of the 
evaluation team that not onl/ the basic goals of the eight projects but, also, 
the general strategies employed are more similar than different • this might 
be explained In terms of conrnK^in philosophical base for career education^ 
Apparently^ the conceptual i:isat Ion of the^program at each of the eight sites 
have been based upon a similar origin* A point of common origin would of cour$e 
be the writings and materials produced on a national level y. However, evfdence 
exists at 4he state level of a coordinated approach to career education. A 
conceptual statement has been developed at the state level as well ag by the 
RCU^ Further, the pVTE has talcen a leadership role for the Department of 
Education as It relates to^careet educatron* Both administrators and teachers 
at the eight del ivery sites noted these f^cts/ 

In respond insf to quljstl^s during sf visits retatlhg to the broad 
spectrum of the DVTE, many people Interviewed expressed concerns about what 
they termed the ''division'' between career education and technical education* 
Several^ stated that they felt this divisiron detracted from the potential progress 
of the career education project* There Is speculation amdBg LEA personnel 
that the top level administrators J n the State Department of Education have 
given career education a lower priority than it held two years previous. 
Factors cited wefe that a) It appeared to many Individuals that the high priority 
verbalized by stat€ department officials was not in reality practice since the 
DVTE was charged with the responsibility of Implementing programs, other parts 
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of the department 414 not view career eduction as a high priority, antf b) 
career education Is basically a broader cot^pt and applies to all areat <*f 
-«KicatIon» not just to vocational technical education. 

Another factor, that of the local )coramuftIty_, has given a particular 
Gdntektua) "flavor" to the project. In review of^he or/ ginal proposals, the 
cowminlty was always proposed as an active partner In the career education , 
program. Goals and objectives of the proposals reflected the need for Irtvolv*- 
M^t be^rfeeh the schools and the communities. The context of the cornmunltles 
appeared to have a significant effect upon the strategy of the delivery system. 
A portion of Sect I on 1 of tht s report dl scussed the three types of 
communities - Suburban, Industrial p>Asr leu Iture and Agricultural. One of the 
basic assumptions of career education Is the active participation of the total 
community, not only the school. In the educational process. As mentioned, 
this vies a comtiion theme of each of the proposals. However, If one examines - 
the current responsibility of career education as a function of the school as 
compared, to the community a significant difference Is noted between the operation 
of the three community types. This difference In practice seems to be much 
mor^ apparent than that reflected In the original proposals. Figure 2.1 
presents a relative comparison of the responsibility of school and communities 
by the three community types, it should be noted that the following general 
statemeots may not apply equally to each community within a type. 

In comparing the responsibilities of schools and communities, for the 
suburban projects, a relatively greater proportlon(of responsibility for the 
career education program can be and is/&eing assumed by the communities'. 
For example, In these communities, reside Individuals of many bacltgrounds who 
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are ayal I^M^ I nstrMctloh purposes > L, tkewlsd $tucSenti havd dcces$ through 
the co^ Irtfonnattdn, Students could 

observe almost any Occupratton In act^^ In tha industrial-Agricultural coirt*^ 
liiunttiest the rasponslbiif evenly shared* These communities usually 

have a diversity of resouT^es but not as broad as that of the metro areas. 
SofM of the more specialized occupatlotis may not be found In these commuhi ties. 
Itii the agrtcultural coiUmunityi the school must assume an Increasing responsl- 
btlity for career education^ Limited resources are aval lable within the 
ifMiiedlate community* For examplev^^*Flrst band^* Information about Occupations 
may not be avaitable to the student without commuting to a metro locatloh. 
in these areas, schools must assume the major responsibility for securing such 
Information for their students^ these contextual factors have made a subtle 
but observable difference In the conduct Of the projects. ^ 

The above contextual factors ^ not necessarily recognized in the Initial 
proposal designs, also give support to the impiementatlon of an eight site , 
versus a one site model, V/hlle the Implementation design of the projects was 
similar, the need to make ^•adjustments^* of actions oh the basis of local 
convnunity resources has been observed. This factor might not have been discovered 
}f only a single site model had been implemented. 

Contextual factors more Immediate to the projects and students are more 
difficult to generalize^ It is anticipated that the final evaluation report 
0f the RCU Will address a number Of Student variables and relate these to 
outcofhes. It was evident that organisation and attitudes Of district admin'- 
istrators also help to shape the projects. ^ Discussion of this point will be 
In the ntxt section. In summary, a number of factors at the federal state 
and local levels provide a context and help to. shape the particular prpjectsV 



Soffl4 are predictable and some are not. Those which are* for example* the 
resource support level of a cqmimifilty, should be a part of future planning 
for similar projects* 

2.3t ftevlew of Management 

Management was reviewed to assess the pifocesses aKid products of the 
project In defining* developing and implementing an organizational plan for 
managefflent* Its IhGcptlon, refinement and operation* This Included Identif 1- 
c«tf]|n |nd/dr adoption of new or existing management plans. Further, an 
ittempt was made to determlhe the method(s) by wlilchr this occurrad* the 
persons and/or organization who were primarily responsible for the Inception of 
the basic plan arid/oKi.ts revisions. 

the- eight project sites employed various organizational and admlnlstrattvo 
strategies. At one site an elementary principal served s$ a part-time 
project director;. In another, a teacher was employed as part-tlnw director; 
in still another, the vocational education drr^ctor was utilized as part-tline 
project director. In at least one district, the project directors' responSl- 
bltlties were shared* Because of their size, none of the project Sites ' 
alloyed a fullttlme director whose solo duties were the career education project 
The larger schools typically utilize the services of the staff member who Is 
already assigned coordinating or directorship respotislbllltles in the area of 
vocational -technical aducat Jon. The mIddle-Slzed schools^ the Industrial- 
agricultural communities, tend not to have a full-time regular staff member 
devoted to coordinating or directing the vocatlbnal education program. Thera- 
fore, these schools omployed cither teacher personnel or other administrative 
fiirsocinel on a part-tlmo assignment basis for the duties of the project 
dlractor. This is also true of the agricultural community's school In 
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Plalnvlew* In discussions with f^roj ci:t personnel of projeots» 

actions. It appears that the foltowing observatlcjns resardfng the organizational 
and administrative strUQtui* are Just V 1 * 

U thei-a is a direct relationship between pto^rQ^s of prVject activities 
and tha degree to Vfhlch the project director Is a full-time I Ijve administrator. 
§|it schools where the project director Is either a principal orWtral office r 
. bdmtntstrator who has l Ine authority over teachers, It appears \Qt projects 
•ra more efficient and productrve In their operations. Project directors who 
tiaya' th« complate support of I Ine adwinlstratofs, but who are not themselves 
Vln« administrators, also function effectively. 

(NOTEt We are not making a qualitative judgement of the processes or products 
at this point In time; only the quantity of activity gcsnerated and the overall: 
efficiency observed.) Of all the projects, the one that appears most efficient 
1$ the one In which the career education modei Is located In one school in which 
the principal Is a half-time project director. In this situation, the dlractor 
has full line authority over all teachers ln\/olved In the project. 

the second level of efficiency of management' appears to rest In areas 
where the project director Is a part-time administrator who does not havi line 
authority. This position Is characterized by an administrator who may be a 
coordinator of vocational education, director of elementary education, etc. 
In those situations, the project directors are administrators who do not have 
classroom teaching assignments during the day and. although they may be davotad 
only part time to the career project, they are free to meet with teachers, 
usually throughout the day, at the convenience of the teachers. 

this second level Is contrasted with the third level In which teachers 
have i>aeh selected for project directorship on a part-time basis and who have 
rMtaintng responsibilities as far as classroofrt education. In these situational 
th« project director Is free only designated hours, the director Is usually 



* setondary teacher who hM^^^ 

teachers only before cr after schoainor during his designated free hour*, 
this situation appears to Umlt the access of teachei's to the project director. 

2, Another consldoratlon of the orgarilzattonal and admlnlstratWe 
strategies Is the level of comwItnjentbV top level administrators In the school 
district. This sftuatlon way also be related to the ^Ize of the school district. 
For example, -In the smaller schools* to many Instances, the career orientation 
program was the top priority - or, at least one of the top priorities - of the 
supefihtetident and top administrators. In the larger suburban area schools, . 
the program of career education often had to* contest for time with other 
worthwhiie aftwl needed prograns and could not become a high priority commitment 
of the top level admlnlstratort. The evaluation team members gained tha dlstliwt 
Impression that where top level administrators werl^ supportive of the program, 
the reflection on the amount of activities and the offerings of the program 
. were' greatly_jMihaj«jtd,._: -^-^ _:v^.- _ 

This Impression was generally supported by the data contained tn.Table 2.1. 
This table contains data generated by the RCU on teacher activities at aeven 
of the eight sites. (One site. White Bear Lake, was not Included since Its 
pfdject Just began operation this year.) With minor discrepancy, those sites 
which show the greatest number of Instructor hours would reflect the level 
of /greater <lomml tment by the top level, administrators. It should also be noted 
tl^t the aoiQunt of Insteuctor time Is not positively correlated With district 
size, itather. It Is somewhat negatively correlated. In general, the evaluation 
team concludes that the data obtained through Interview, cbsar^^^ 
/teacher process questionnaires from the ACU indicate that the attitude and Impact 
] of top level administrators has a direct relationship to the level df activity 
Stfiarated by the project. 
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the strategy of teacher Involvement varies considerably from project site 
to site. Techniques MSed vary from asking for teacher volunteers, to teachers 
bel tig selected, to performance contracting, and to mandated Involvement of ' 
entire systems, the acceptance by teachers also varies by grade level within 
a given site. The acceptance by elementary teachers Is generally greater than 
that of secondary teachers I -T^^^^^^ true of their willingness to volunteer 
as well as the amount of activities observed as a result of their partI<iIpatIon 
.in th6 program* There also appears to be an at^m^Inal-dlfference between 
elementary and secondary teachers* its reasons might be expl^ilned' In the 
following way. 

Elementary teachers have to work with the educational process of the 
whole child J i.e., Ihe elementary child generally only sees one teacher for 
classes^ with a smaTi amount of speclailzatlon for music and phy. edi Thus, 
the "whole" responslbil ity for education lies with the elementally teacher. 
Since career education Is seen as ah Integrated process of education, tt, 
therefore. Is a part of theVespdnsIblllty of the elementary teacher* At the 
secondary levels, teaching Is departmentalized and teachers often see themselves 
•s subject matter specialists. Mathematics, with or without an attltudlnai . 
dimension, is the responsibility of the mathematics teacher. Other aspects of 
the students development Is often viewed as someone else's responslbil Ity* 
This attitude is often strengthened by the administrator and "accountability" 
systems of the school; I.e., fliathematlcs teachers are held accountable for 

mathematics, etc, . i 

In observation of the secondary programs, the study team concluded that 
the Impact of career education is less than that In the elementary grades. 
Generally, the strategy employed In the secondary schools Is the establishment 
of resource centers for student InforiTiatlon. Involvement of the students 
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Usually cOtties In the area of social studies and/or guidance. .In discussion with 
teachers and project personnel, most were aware of , the dtffJculty In Integrating 
career concepts Into secondary education* There was general agreement that 
the most effective way to '•access'' the secondary program Is through a "neutral' 
dl$trlct-"wlde area like guidance* Generally, this was the avenue followed by 
the j^econdary programs* One site has made successful utilization of performance 
contracting at the secondary level. This mechanism has the advantage of se- 
curing so called "volunteer*' teachers who are also directly rewarded for their 
efforts* In the opinion of the evaluation team, this management strategy has * 
the potential for access to the secondary schools and promises to be effective* 

Interviews with LEA personnel were structured to elicit responses from 
school administrators, project directors and teachers about their contacts with 
State Department personnel* Reference was made to design. Implementation, 
progress, communication and evaluation responsibilities by the State Division 
of Vocatlonal-Technlcal Education. * ^ '^'^^'"'^ 

Most people Interviewed were very positive In their reactions to State. 
Department personnel with whom they have had contact related to this project. 
They felt that the leadership has been excellent by the personnel directly In 
charge of the project. Most of those Intervlev/ed Indicated that It would be 
advantageous to their project to have more contact and communication with the 
members^ of the State Department team* More on-sltfc visits were requested. 

In summary, the responsibility for management was centered with the 
project sites and the DVTE* The Interface between the LEA sites and the DVTE 
operated well. Communication patterns had been established and problems met 
wlth^sblutloils* The only criticism which was voiced was the need for more 
on**stte Involvement by State Department personnel* In regard to the organizational 
structure of the^rojcct sites, the size of the grants generally determined that 
there would be two levels, that of a part-time project director and teachers* 
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The bosltlbn occupied by the project director In the organization (LEA) appears 
to have a major Influence upon the activities of the project. The higher his 
position and the more his direct line authority, the more influence he has 
and subsequently the greater activity of the project. Likewise, the commitment 
made by top level administrators pTays an effective role In project activities. 
The more commitment, at Jeast visible commitment, the greater the amount of 
activities generated, 

2,k Review of Instructional Systems 

Whatever physical settings and delivery models exist for education projects 
the nucleus of each Is the Instructional system. Although the training modes, 
organizational meth^diynd cl lents .have some diversity among project, they 
hold In common the deHi4 to help Individuals choose ajd be trained for Improved 
career adaptation. Any plan for training Implies the presence of an educational 
structure or system that provides carecr-awarenfcs^^^areer exploration, career 
priparatibn and, If necessary, assistance In learning fundamental skills such 
as reading, writing and arithmetic. 

The processes employed by the etgKt-^s vary considerably, while at the 
same time, have some commonalities. One of the common threads linking the 
projects through process Is the utilization of tn-servlce training for ^achers 
prior to the Initiation of the project as well as during the project. An 
eight sites use some type of In-service training for teachers. The results 
of the' training and the enthusiasm of both administrators and teacheVs for the 
In-scrvlce varies somewhat among the sites, but Is generally held In hlrgh 
regard. Project directors and most teachers Interviewed Indicated that the In- 
service training forms the backbone of the project. 

^ Many teachers, although doing some things already In the area of career 
orientation, were really not aware of many of the techniques or materials 
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avaHable. ilkewisei many of the teachers were not aware of the posslbf 1 1tfes 
within their own locality regarding careers and career orientation. Teachers 
quite often Indicated that they felt confident I discussing careers much like 
their own careers; r.e., professional careers such as doctors, lawyers, teachers 
etc* Elementary teachers also Indicated confidence In being able to discuss 
with students, the traditional careers dealt with In the elementary grades, such 
as doctors, firemen, policemen, nurses, etc. However, as teachers moved dway 
from the more familiar careers to less familiar careers, they voiced a strong 
need for ^n-servlce education. 

A number of the sites have responded by taking teacher field trip days In 
which teachers tour companies within and near their local communities to gather 
first-hand information on various career opportunities. This strategy has been 
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tllized by a number of the projects and it appeared to the study team that 
this was a very valuable activity for teacher training* However, this effort 
has. In some instances, been only an extension of what had been done In the 
past. In some sites, contacts with Industry and field trips are encouraged 
in theory but limited in practice by administrative constraints. 

Another positive aspect of teacher In-service was that of bringing in 
outside spciakers to speak to teacher groups on the area of career education. 
In some Instances, this constituted a kick-off to the project. In respect to 
this activity. It appears that Its usefulness Is short-lived unless It becomes 
quite specific to various job occupations and tasks. In some Instances, where 
large groups of teachers had gathered to hear speakers, teachers felt that 
the speakers did not address their questions and that the sesslons/were not as 
productive as they envisioned. In sessions held later In the VMr, some of ^ 
these problems were resolved. 
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Some sites utilized emplayer representatives from the local communities 
to cbnie In and speak to teachers regarding employer expectations of employees* 
These sessions appeared to be valuable to teachers, especially if they were 
conducted In small groups In which teachers who attended the group had a gen- 
uine Intereist In the employment area that was being dUcussed* In general, 
tt appeared that large group settings for in-service were not as productive as 
smaller group settings which were more specif 1c» ^ 

^ In another activity which relates both to the process and to the products 
produced, most of the projects employed teachers for varying amounts of 
time to develop curriculum and/or career orientation activities for use in their 
classroom and other classrooms (jn the project schools. This met with varying 
degrees of success under varying* circumstances • In terms of the volume of ma- 
terials produced, it appears that when teachers are employed for block periods 
of time, namely, recruited for two weeks or more during summer vacation for 
curriculum wrLting duties, that a greater quantity of products are produced 
than wfieilteachers are recruited periodically on Saturdays during the school 
»erm to produce curriculum* A number of the project directors indicated that 
there must be paid time available during the summer months if one Is to 
successfully produce curriculum materials. 

With the exception of two sites, the remaining sites have concentrated 
their efforts upon the elementary grades during the first year of operation* 
During the second year of operation, many of the sites have progressed Into 
the junior high and. In some cases. Into the Senior high school area* Delivery 
strategies also varied among and within sites according to different grade 
levels* At"^the elementary grades, the activities generally centered around 
orlentatl(^ programs for students to the various employment opportunities, not 
only within the immediate area of the project, but also on a broader scale* 



At the middle grades, wore effort was |>laced on "fact finding" by students; 
that is* students did extended research Into specific job opportunities In which 
they inay be Interested. This usually Involved a broader spectrum of job oppor- 
tunlttes than was usually . Inveitl^attjdv Id ujipor grades. In the 'upper grades, 
the primary eri^has4& was upon In-depth research Into a smaller selected number 
of job opportunities. This might Include tn-depth research of various careers- 
by students, or It might Include actual participation by students In the em- 
ployment setting. 

In terms of the_products produced by the schools, they vary also. There 
.1$, within the eight project sites, a varying emphasis on specific curriculum 
materials. However, all sites have produced some curriculum or career orienta- 
tion activities. These may vary from Informal activities which have been dts- 
trtbtttcd by teachers or by the project director to other Interested teachers 
to a formal curriculum manual for career orientation 'which has been formally ' 
adopted by the Board of Education and distributed to all project teachers at 
appropriate grade levels throughout the school system. There appears to be 
advantages and disadvantages to this technique. Some teachers voiced a strong 
degree of satisfaction with the curriculum materials in that the materials were 
easily understood by them, directly usable*by them and provided valuable ex- 
periences for their students. Generally, teachers requested some form of 
documentation. Other teachers expressed almost the opposite view. Thl s may, 
tn part, be due to the type of In-servlce that was provided to teachers. 
Some teachers expressed the Idea that the curriculum manuals or activity guides 
were so voluminous and encompassing that they could not see any utility In 

their application. ■ ^/^ \-vv'''' .-■■-r- - ' ^'.-..^.-.^ v.:.-::-';^' 

One other process related to the production of products Is noteworthy. > 
One of the districts Is utilizing a system of mini -grants to teachers and their 



students for project activities. Under this sysjiem a formal contract Is written 
with a teacher to develop a given project under certain conditions with profluctlon 
of certain products. The project will then reimburse the teacher with certain 
materials, supplies, etc., utilized in the project as well as a stipend to the 
teacher for specific curriculum development. Although this project began oper- 
ating just during the past year, it offers consLderable promise In terms of Its 
processed used to develop products. At least one other project has expressed 
an interest In adopting this procedure. 

It appears that there is no relationship between the processes and the 
products of the sites as related to their size, location or other general 
descriptors of the project as discussed previously. The only thread that may 
flow through the projects is the fact that larger projects, namely those In the 
metropolitan area, tend to select either pilot schools and pilot teachers 
or both. These systems, for the amount of money available to the projects, 
are too large to develop the project' in an entire school, through an entire 
grade level or through an entire distr'ct. In smaller schools, the project 
has Involved all the teachers at certain grade levels, all the teachers at a 
particular building or even, in some cases/ tried to Involve all teachers In 
the district. 

Student outcomes, as related to the instructional system, are being assessed 
by the RCU through a series of tests. A discussion of this aspect will be given 
later In this report under Review of Internal Evaluation. Separate reports 
on this aspect are also being produced by the RCU. 

2.5 Review of Information Systems 

The primary purpose of an information system Js to satisfy the Information 
needs of an organization - which are mainly concerned with decision making. 
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the>yst6m must provide accurate and timely data with which to expedite these 
declsiotis^ »n this way, It serves orgahlzat ion management as a tool to faclll* 
tate the adequate control and guidance of the production of the. services and/or 
prodgct$ for which the 6^^^ 

* For many people, the term "Information system" has the conhotatlon of a 
highly mechanized or automated scheme or system with a fally complex and ob- 
v; icure structure* - An Information systaii need riot be large, complex or automated 
to be effective. A simple manual process of collectlpn and reporting data can 
be very successful If It has been developed In the complete reflection of the 
heeds of an organization it serves. All functioning organizations, regardless 
of theiV size or purpose, have an Information system of some sort - Intentional 
or not. The question Is whether or not an organization's collection and use 
of Its operating data is systematic. Usually, the more systematic the process, 
the more efficient and effective It and Its host organization tend to be. 

For purposes of this evaluation, the review of the Information system was 
divided Into two general areas: 

a» Information about the project and career education but not 
including Information delivered directly to students In the 
Instructional process. This would Include general project 
dissemination and resource information, books, manuals, materials, 
etc*, about career education generally utilized by teachers^ sCich as* 
^ professional resource center. 

b* Internal and external information which was util Ized as feedback 
for use in management. This portion of the information system would 
integrate very closely with the evaluation system. 
All the project sites have developed some type of professional resource 
centers. The extent to which they have been developed, their utilization and 
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apparent effectWeness varies. There appears to be no specific relationships 
between the sites and the utility of the professional resource center other than 
the possibility of logistics for som^ of the larger, more diverse project sites. 
Although specific use of materials could not be determined frpm existing records, . 
teacher reactions to use of materials related closely to access Lbi I ity. 
Teachers who were physically located in the same bui Iding as the resource center 
tended to report greater usage of materials. More format methods of distributing 
Information to teachers usually Involved a staff newsletter published by the 
project. The evaluation team generally perceived the information system to be 

« 

operating effectively within each ^ the project sites. 

Feedback Information to the sites for use in management generally consisted 
of Informal feedback. Later in the school year, when the teachers "Self 
Evaluation of Career Education" instrument became operational, mot*e formal 
feedback was available. This device provides formal -feedback to both the project 
directors and participating teachers related to the type, amount and effective- 
ness of Instructional activities (see Tables 2,\-l,h), The problems and delays 
Involved in producing the Instrument and the process of data collection and 
feedback prevented this system from becoming an effective management tool during 
this past year. By the time the system became fully operational, it was too 
late fn the school year to make effective changes, if such were desired* However, 
the system Is now fully operational and should provide' timely feedback to 
project during the next school year^. In discussing the Instrument with teachers, 
^ problem was encountered with clarity of the form and Its directions. The 
Instrument has undergone revisions and with orientation or re-orientatlon of 
teachers, this system could be useful for feedback to projects and teachers. 

2«6 Review of Costs 

A project's plan and associated procedures for accounting for Its expendi- 
tures is Important for two separate reasons; (1) simple necessity f^r the project 
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to function in a business-l ike manner and to account completety for the expendl- 
tures of its funding, and (2) its responsibility as a research and development 
project to accurately fix the cost of its various processes and products in an 
effort to*bnalyze Its effectiveness and to promote possible replication. 

the first of these is, of course, the most direct and is easily accompli shed * 
AM LEA'S have standard accounting practices and follow the federal guidelines' 
relating to cost accounting, etc. No formal review of cost accounting practices 
was coriduc ted by the evaluation team. However, In discussion with the project 
director, the working relationship between the LEA and the OVtE as it related to 
budgets, cost accounting and receipt of monies was considered very good. ^ 
Prbjects reported receiving monies on time and. that the liVTE granted reasonable 
budget reallocations quickly* Apparently, no major problems exist In this area 
between the LEA and the DVTE. 

The second area was very difficult to assess. It was difficult to'allocate 
costs to specific functions and to determine, for example, a per pupil/served 
expenditure because of many confounding factors. It was even more difficult to 
determine a cost/benefit relationship. 

The budgets of the project reflect both federal and local expenditure 
categories. In some projects, the cost of the project director is "charged" to 
federal. In others^' to the local, and In still others, to both. Likewisei many 
other expenses are shared. Many of the local expense? are so called "in kind*' 
expenses and are only ^estimated. This might include consumable supplies, use of 
duplication facll Itles and many other Items that are difficult to maintain 
accurate cost data because 0^ sharing with other school programs. In this 
tespect, ^our broad classifications were established to allocate budgets for the 
1072-73 school year. These cil ass I float lonS were: 

i. Administration - salaries oX project director, secretarial 
assistance^ travel, etc. 



2/ In-^servlce and Curriculum - In-service expenses of consultants, 
etfc. and payments to teachers for curflculum writing workshops, • 
- ^ . -etc.- ■ . 

3, Materials - Thl% Included teacher and student materials and such 
expenses as field trips for students. 

Other - All other costs which could not be allocated to the above 
categories. 

Since many assur|ptlons were made In terms of the cost allocation, an 
approximte percentage distribution of the cost niay be the most meaningful' and 
Is as follows: * / . 

TABLE 2.5 

V APPROX I MAtE fcOSTS BY CATEGORY 

(All Projects) 

CATEGORY t of/ tot AL COST 

Administration 

In-service 6 Curriculum Writing 
Materials 
Other 

tOtAL loot 



The dlstrlbutloh of costs among sites varies considerably depending Upon 
the emphasis of the projects. For example, In-servlce and curriculum writing 
ranged from less than 20!!;, to about 60% for Individual sites. It should be 
noted that internal evaluation monies were not Included In any of the categorl 
•s that effort was a separate contract with the ^Cii% 

A next logical step mlSht be to divide ^ he monies allocated to specific 
functions, such as In-service, by thfe number of teachers Served to determine 
an average In-service teacher cost. However, the yar lance In the ln-4ervlce 
designs makes this type of cost computation somewhat meaningless. For example 
most sites provided either one^half Or a full day of In-servlce which could 




bft easily accounted for In the cost calcuTatlon. However, In-servlc^e design for 
some projects was United to small gr.oup rn-servtce, groups of 15-30 teachers. 
Other designs served all of district teachers at a given function. Thus, the' 
cost would vary greatly with the design. A more meaningful analysis of costs 
might be to project the costs to other districts given a hypothetical I n-serv Ice 
plan. Given that there are a number of transportable products available from 
these projects, another district could estimate Its costs as follows: 

TABLE 2.6 

HYPOTHETICAL INSERVICE COSTS ESTIMATE 
PER TEACHER PER DAY 

I tern ■ Cost/Day/Teacher 

1. Administrative planning , None (In fel-rid) 

2. Substitute teacher pay $30.00 

3. Consultant expenses Including 

travel and preparation 7t50 

k. Reproduction 6f Curriculum materials 5«00 
5. Other 2.50 

TOTAL S'tS.OO 

The cost, analysis assumes the following: 

a. Administrative planning for the In-service, such as securing materials, 
consultants, substitutes, etc.. Is an "In kind" district expense. 

b. That the major purpose of the In-servlce would be to review existing 
I curriculum materials fromother projects for revision and adoption to 

local needs. 

c. That the In-servlce Is conducted; In groups of 20 teachers per consultant 
In observation of the eight delivery sites, the evaluation team believes 

I that $^5/teacher/day Is a realistic cost. All projects expressed the need for 
extensive tn-servlce and suggested that monies expended for this activity were 
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well spent. Review of the materials available for the eight Minnesota sites 
as well as other demonstration sites around the country would suggest tl^at 
resources might be irbre wisely expended In review of existing materials' rather 
than In constfuctlon of new materials at least for an Initial orientation of 
faculty to career education. 

Anoth|r method of. examining cost would be to determine the overall cost 
per student serviced. Thus, excluding the project which Is In Its first oper- - 
atlonal year, about 17,000 students were report^! y served. The average federal 
cost share per student served was about $60^00. This figure would represent 
5-10% of the total educational expenditures for each student. The magnitude 
of this expenditure would also be considerably less than that of other special 
aid programs, such as Title I whgre.per pupil expenditures generally reach 

^ * ■ 

several hundred dol la rs per student. 

Another way In looking at these data |s In terms of the cost per student 
tnstruetlonal contact hour. The tables contained previously In this docurtent 
report data on the number' of teaching hours and number of students served. 
Utilizing this type of analysis the average cost per Instructional contact hour Is 
slightly less than $.16. This flgurS" would, of^course, be only federal costs 
and would not Include basic teacher salaries, etc. Thus, If the average cVass 
size served by a career education activity were 30 students (In the project site, 
it was 33.8 students) the approximate cost would be $/|.80/class hour. In trans- 
porting these types of programs to other schools, the. costs could be reduced 
considerably If the following two assumptions were true. 

I. The administrative costs would, be an "In kind" expenditure of the 

district. 

2* Basic direct costs to the LEA Included only In-servlce and materials. 



It should be emphasized that the cost calculation of this portion are 
based upon a number of assumptions and are tentative at best. The strategy 
employed by aj^ LEA In Implementing a career education program could alter 
the figures presented hbrc considerably* However, thp evaluation team feels 
that the figures are realistic estimates within the assumptions given. Mo " 
cost/benefit analyses was attempted. 

* > ■ ■ 1. a , . ■> 

.2*7 Review of Internal Evaluation 
w^^Cvaluatfon tn rfesearch and development projects Is primarily a fnechantsm 
for maintaining and/or refocustng project gbals and objectives. Parttcular 
descriptors such as I nternal -external , format I ve-Summatfve ac<i^ seen as parts 
of the whole and cannbt be examined separately but must be viewed as factors 
within a time dimension that may produce varying reinforcements and/or 
modifications to a proje-t. The total evaluation process passes through different 
stages at given tlrtes. For example, periodically, there may be planning or 
design phases for evaluation strategies and activities which are to be carried 
out In Succeeding months. Then there may be periods of data collection, analysis 
and redesign. In this way, tHe entire activity Is viewed as a whole whlch^ 
provides Information to project decision-makers as a supportive function to 
the overall project goals. 

To determine the Influence which' the evaluation activities may have upon a 
i>roJcct, it Its necessary to document fully the activities Which shaped the 
evaluation effort. Those activities must highlight those decisions relative 
to the use of the evaluation Information and the priorities placed on It, as 
well as the effect of the Information on the subsequent decisions. The purpose 
of this portion of the third-party evaluation}^ was to monitor the significant 
activities which formed the Internal evaluation effort and to document the ^ 
effect of this effort as a shaping mechanism and/or forcing function upon the 
jproject. ^ 
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During the f li*st year of operations (197l'-72) each of the eight 



sites were charged with evaluation of their own activities and proposed outcomeSt 
Slnc0*lhe budget of the projects relative to evaluation was small, limited" 
results were obtained in this area^ Subsequently, a decision was made to 
••pool" evaluation monies and to conduct Internal evaluation activities through 
the RCU, Thus, virtually all evaluation, at least formalized evaluation, was 
assumed by the RCiJ^ 

Evaluation conducted by the project sites consisted of teachers evaluations 
of students on individual activities or units and formative feedbacic Information 
from Individuals to project managements Although this form of evaluation would 
be considered informal, no doubt significant decisions were made on the basts 
of this data* There v/as, however, no means of documentation of such, and de- 
cisions resulting from such were not •^traceable". Evaluation activities during 
the first year of operation also consisted of formal site visits and reports 
by state department personnel. Thus, during the first year, formative evaluation 
of the project was accomplished through a combination df information, both 
Internal evaluation and formalized feedback from the state department was 
utilized* 



undeKaken Jn the evaluation effort. The RCU concentrated its efforts In 
two areas: 

K Teacher self-evaluation activity - gathering of data from teachers 
I on teaching methods, effectiveness of methods, number of students served, etc* 
2* Student Product Evaluation • This area included the development of 
career education tests for students In grades K-3> ^-6, and 7-9* These- 



tests were primarily ••aimed'* at the cognitive area rather than psychomotor 
or affective domainti^* 



By pooling the resources during the second year, much 
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2.7*1 Teacher Self-Evaluation (TSE) 

The data gained from the TSE was designed to provide feedback Information 
to teachers and project management as to the types of Instructional strategies 
being utilized by teachers. Upon completion and analysis of this instrument, 
teachers and administrators could then review the methods being used in the 
classroom, the amount of time devoted to each, teacher perceived effectiveness 
of the method, the number of students served, and the career education objectives 
and content covered by the methods. Analysis was done by sit^, school, teacher, 
grade and curriculum area and could provide data across all sites by grade level, 
within schools by grade level, etc. Teachers were requested to^corrtplete the forms 
daily for each 6#reer activity for each class. Each form can contain 20 career 
activities. - 
« The development of the TSE Instrument as well as the student Product Evaluation 
was and continues to be a part of the total Minnesota Career Education Exemplary 
Model. That Is, the development of an evaluation system was and Is one part of 
the model along with the eight delivery sites. The fact must be kept In mind 
as one. examines the evaluation effort. 

The content design of the TSE cai^ be traced to documentation by the RCU 
concerning the rationale for a carei&r education program. In that document, a 
model design was advanced. From this a more specific evaluation model was 
developed based upon a career education objectives matrix. The TSE Instrument 
was a logical extension of this base for analySjS of the delivery system^ In 
examination of the development of the TSE Instrument, the evaluation team found 
a logical set of sequen)L-iul efforts. The development of the form and Its 
analysis system did, however, meet with some problems and delays. In retrospect-^ 
the time schedule proposed for its development and production of feedback infor- 
mation did not allow for a number of problems encountered. This was evident 
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from discussions with teachers and project personnel during the first round of 
site visits. Host, however, were understanding of the developmental delays and 
by the second site visit (May, 1973) the delay problem\had generally been 
eliminated. However, a number of problems were discussed with LEA per^jppnel 
relative to the instrument. The major areas of discussion were? ^ ^ 

\. Clarity of the instrument form itself - teachers indicated problems 
with being able to follow lines and columns and to be sure that^ they - ^ 
were marking the correct column - the* form requests much infortnytlon and 
the r0sponse fields ar^ closely packed. The RCU has responded jto this 
problem by re-design of the form including spacing, shading an^i blocking. 
The new form design should correct any problems previously encjbuntered 
and Is available for use for the igyS*?'* schopl year.. 

2. Instructions for completing the form. The RCU initial ly conducted 
a, session with project directors as well as providing Written Instructions 
with the form. The evaluation team did not feel that instrijct Ions were 
a serious problem and that much of the discussion was simpiy due to mis- 
understanding and lack of familiarity with the ^strumenti^ These problems 
had substantially decreased by the second^ round of site visits. 

3. Time required for completion of the form. This crltilcism was generally 

discounted by the evaluation team as a reaction' to dn additlbnal task 

I 

and some confusion which related to the form and directions. Data obtained 
from the TSE form would suggest that it was not that time consuming. In 
total, over 10,000 activities were recorded. Table 2,7 presents a dtstrlbu 
tlon of iihe time required for completion of the form for each- act ivity. 
Nearly half of the time the recording JproceS^ required less than 

three minutes of teacher's time per activity. NearJjLsOO teachers (^98, 
dtcording to the^ RCU data) participated In career ^education activities* 
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This would average out to be about 20 activities per teacher per year. 
At an average completion time of 3 minutes/activity, about one hour of 
time would be involved for the average teacher during the school year 
for completion of the TSE forms. This does not appear to be an excessive 
amount of time. .» • 

. TA'BLE- 2.7- 

TIME DISTRIBUTION FOR COMPLETION OF THE TSE FORM 

Time Percentage 

Less than 3 minutes ^8.7 
3 ' 6 minutes . 37.9 

. JMore than 6 minutes 13V^ 



^i.^^^irccuracy of Data. Many teachers Indicated that they did ncM:"complete 
the form dally and that at the end of a week or a month recall of 
Igcitvlties was difficult. This problem is difficult to solve 5tKer than 
t|» try and Impress upon the teachers that their assistance is needed. 
Possibly a weekly collection schedul^e by project directors would help to 
increase promptness. ^ ' ^ * 

5. Timely analysis of the da ^a. The analysis program met with unexpected 
delays and feedback inffl-mat I on was late In arriving. .However, at this 
time, the programs are fully operational and no substantial delays should 
be encountered during the next year. 

6. Utility of the feedback Information. Some teachers questioned the 
usefulness of. the Information both to |them and to project directors. 
Project dl rectors, however, were supportive of the Information utility. 



It cannot be Realistically expected that all teachers will agree 
with tlie utility of the Information, Some additional in-service 
activities related to this area could hfilp many teachers under- 
Stand anU util Ize the feedback* information. 
/ The TSE form also collected data relating to career education objective/ 
content area being taught by teachers. Table 2,8 contains information collected 
by the RCU for a number of objective/content areas. Seven different areas from 
"Self Awareaess"* to the "Planning t'rocess" wer^ anarly^red. Frequencies are pre- 
sented for each of the seven oj^erational projects with summary data presented 
for the three project groups. If one examines the percentage distribution of 
objective/ content within each of the seven areas and compares, the distribution 
by community grouping, a substantial amount of^ sfmi lar ity t$ found. For example 
for the area, "Work Roles: Iforkers:, the percentage distribution of tlje fre^ 
quencies for "Meeds and Satisfaction", "Mental -Physical Abilities" and "Educa- 
tional Needs, Goals", have a 1-2-3 ranking in each of the community groupings. 

Table 2.9 presents a condensation of these data In Table 2.8 as they 
relate to the most frequently taught objective/content for each of the seven 
areas. As can be seen from these data, except for the area Of "Occupational 
Area" and •'V/ork Roles: Requirements", all three project groupings have given 
primary emphasis to the same objective/content area. These data would suggest 
that although the community characteristics of the project sites differ, 
there' Is either by design dr circumstance a very sfmllar^concentration of 
objective/concepts In each type of site. 

Further examination should be made by the project sites and the DVTE as to 
the emphasis of objective/content within given areas. Within some areas, a 
generally uniform emphasis of objective/content Is being applied whereas In 
other areas a considerable variance Is shown. 
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TABLE 2.9 

MOST FREQUENT TAUGHT OBJECTIVE OR CONTENT- 



AREAS 



Self Awareness 



"fork Roles; 
General 



jOccupatfonal 
{Levels 



{Workers 



lOccupat tonal 
(Area 



(Work Roles: 
Kequtrements 



SUBURBAN SITES 



Occupational Needs, 
Goals (2^.23;) 



Kinds of Careers 
(^0.3%) 



Planning Process 



Professional & 
Technical (23.5%) 

Ueeds^nd^at I s' 
faction (h],7Z) 



Communications 
(9.9%) 



Ability Requirements 
(33.01^) 



Career e Educational 
Opportunities (26, 



INOUS-AGRI, 
SITES 



Occupational Needs, 
Goals (25.6?) 



Kinds of Careers 
(^0.7%) 



Professional s 
Technical (26 M) 



Needs and Satls- 
factlon(38./»%) 



Personal Services 
(9.7%) 



Working Conditions 
(31.8%) 



AGRI. 
SITE 



Occ. Needs, 
Goals (27.6%) 



Kinds of Careers 
(38.1%) 



l*rofessIonal & 
Technical (27.3%] 



N»eds and Satis- 
faction (37.5%) 



CommunlcatlohS 
(10.7%) 



Working Condi- 
tions (3/».8) 



Career 6 Educational j Career & Educa, 
Opportunities (27.1%) Oppor. (26.1%) 



For example. ,n the Suburban Site group, for the area of -Self Awareness", 
. variance of frc. about 16% to 2^% ,s netted among the different objective/content 
area while for the area of ."Work Roles: General.' the range Is fr«n about 11% to 
A0%. Again examination should be made as to the basis for this variance; was It 
by design or by circumstance. 

2,7.2 Student Product Evaluation (SPE) 

Tl,. SPE effort. ca,p,et.d by th. RCU consisted of development of test devices 
tc measure cognitive achievements of students In grades K-S. Three separate 
rnstrument. were d«,e,oped for grades K-3. «-6. ^ The K-3 Instrument based 

\ . lObl 



-50- 

Items upon pictorial representations. 

From national statements about career education, a contextual framework 
was developed for the tests. This was further refined into a matrix and pro- 
cedures for generating test items by the RCU. Tentative items were then pro- 
duced in accordance with this procedure and a pilot test was completed. Results 
of the pilot testing, wfiich included a sample of about 4,000 students, were 
then used in refinement of the final instruments. Complete documentation 
of this effort is currently being finalized by the RCU. In review of the 
draft documentation and through interviews with LEA, DVTE and RCU personnel, 
the evaluation team concludes that a very systematic process was followed 
throughout the developmental stages. 

The iKtsi^rumentr were used in an experimental -control testing situation 

- • 

during Hay, 1973. Generally, tha classroom (building(s) which had teachers 
reporting activities with tlie.TSE were considered experimental while other - 
classrooms (buTldlng(s) within the district were considered control. Where 
an entire district was Involved, (considered experimental), other "similar" 
districts were selected as control. The RCU conducted In-servlce sessloi^ for 
test proctors other than the regular classroom teachers. In general, the 
preparations for the testing were substantial and proved very adequate. The 
evaluatiqr^ team was present at a number of sites during the actual testing and 
observed little, If any, difficulty with the testing process. At that time, 
the evaluation team interviewed teachers and project directors relative- to the 
testing efforts. The following represents some of the major topics discussed: 

I. Testing procedures were effectively planned and well implemented. 

Nearly everyone Interviewed agreed In this matter. 
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* 

2* The quality (visibility) of a number of the picture reproductions 
In the K-'S test was considered marginal by iome teachers* 
3» The appropriateness (difficulty) of the language of the K-3 test 
was considered marginal by some teachers. 

k. The difficulty of specific items on the K^3 test was also questioned. 
However, this appeared to be more of an individual situation probably 
related to the topics teachers had been teaching during the year, 
$. The appropriateness of the test battery itself was questioned as It 
related to the goals and objectives of some of the projects. For 
this ar^a, differences were found generally by project rather than by 
teachers. At least two of the projects raised serious questions 
regarding the testes appropriateness. They indicated that the test wa^s 
structured toward the cognitive areas while their project emphasized • 
the affective areasa However, it should be recalled that the SPE test 
was by design a cognitive Instrument and It should also be noted that 
by design, the projects vary in their emphasis of cognitive and 
affective domains. When these facts were discussed, the appropriateness 
of the test was viewed in relationship to the project and it was 
generally concluded that the test was appropriate for the cognitive domain. 
In review of very preliminary results of the SPE tcit, there was apparently 
little. If any, difference between the experimental -control groups. If this 
fact is substantiated by further analyses, it could well be for the following 
reasons: 

1. The experimental -control design was confounded with a number of 
factors. The level of career education activities of teachers varied 
considerably. It is quite possible that many control teachers actually 
conducted as many, tf not more, activities as experimental teachers. 
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The assumptjons that similar communities provided adequate control 
groups may not be justified. The current rational and state emphasis 
upon career education makes Its restrictions to eight localized sites 
questionable. , • ' 

2. The test fnay not be measuring the full Impact of the projects since 
the' test was designed to measure the coghrtlve domain only. 

3. The Intervention model, teaching strategies, amount of resources 
devoted, etc., was Ineffective. 

k. The test Itself was Inappropriate. 

In the opinion of the evaluation team. Items #1 and #2 would be the major 
factors In the lack of obtaining measurable differences In the experimental- 
control model. As additional analysis are completed, this hypothesis may be 
further substantiated. In general, however, the centralization of the evaluati 
efforts through the RCU should realize substantial returns In terms of data . 
available to decision makers. 

2.6 Review of Internal Documentation and Transportability* 
The purpose of documenting Is to produce wrl|:ten Instruments of cotmiunl- 
cation conveying a series of hypotheses and operations of the project. In 
general, 'a project's documentation Is all the written correspondence, reports, 
papers, etc., that are products of the efforts of the project. A pi^oject's 
documentation Is the direct reflection of the project, and to-be viable a 
project must present a consistent and accurate "ptcture" of Itself, Its goals 
and objectives and Its results. The documentation of a project Is not Just 
a means to cotiwunlcate Information to the outside world, but, as Important, to 
serve as the media for the retention and communication of Ideas, findings and 
processes, etc., within the project Itself. 
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Transportability refers to the Identification and potential replication 
of opera t Ions > practices, techniques, etc., from one activity to another or 
from ont school district to another. In assessing transportability, there arh 
many dimensions for constderatloh* 

A frequent problem In the transportability of a model's activity. Is the 
sense of Immedfacy of concluslbns which an© demanded, Thie longitudinal aspects 
of a model dealing with attempts at social Intervention make the Immediate 
appraisal of transportable components difficult and may Interfere with the 
overall modePs goals. A premature conclusion or one tha.t may disrupt the 
environmental* context of a model may be as detrimental to model replication 
as no conclusion at all. This factor must be carefully weighed before feedback 

f Is widely disseminated. ; 

In assessing tVapsportabl 1 1 ty,, various considerations must be addressed. 
For example, It would be Ideal to ""transport" a model to a similar context. " 

, However, this situation rarely, If ever, exists, pal 1st leal ly, relevant 
model Jfu net Ions are extracted whlch^wlll '"fit" the new ^envlronrr^nt. Also^ In 



some Instances, a prp* intervention function Is required to prepare the new 
environment for the Incoming model. This Is a problem which must be addressed ^ 
within the contextual factors * Influencing transportabl 1 1 ty. . 
2.0.1 Documentation • 

Documentation could be divided Into a number of areas.. These would Include 
at least: (I) Project process documentation; (2) project product documentation; 
(3) RCU evaluation effort documentation. Each of these areas Is discussed 
below: V ^ c 

\. Project process dotumentat Ion: In examination of this arcat minimal 
formalized documentation was found. The processes employed by the 
eight project sites were Initially documented In their proposals together 
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with a revision of their objectives. However, modifications have been made 
and success levels may be different aWri^ 

proposed. There is a genqfral needhto^^^^"^ ^""^^ process documen- 
tation within projects and to revise dcrfeumentation related to project 
objectives. * , 
2. Project Production Documentation: All project sites have documented 
products in the form of resource guides, curriculum , materials and 
the like. The quality and quantity vary among sites but, generally, 
documentation is adequately being provided for in this area* 
3e RCU evaluation effort documentation: The RCU has and is in the pro- 
ces s^of^p rov^i dTng^ul^^ 

Currently, this documentation Is in the process of revision and, upon 
completion, should prove very sufficient. The evaluation team did not 
review supportive documentation describing the development of the TSE 
1 list rumen t and*^^^^^ this aspect with other RCU 

documentation. Suppbrttve dopumbntation on the SPt Instrument was reviewed 
and Is in the prdciess of being finalized. 
2.8*2 Transpdrtabi lity 

The Mlnnesdjra Model hd^i^^ areas of clearly identifiable trans- 

portable elements With a third as a possibility. The first two are the pro- 
ducts of the eight sites and the evaluation devices. Oocumentation Is 
sufftcTent for these product to be easily examined and understood by potential 
users. However, some of the products of the sites may be restricted to 
locality, for example, resource guides 1 i sting community personnel, (Btp* would 
not be directly usable in another community. However, curriculum materials 
should be generally applicable. 



The evaluation devices constructed by the RCU should also be widely trans- 
pprtabTet; Applicability to situations will determine their direct utiUty* 
For example^ the Instrumentation presently available will be limited to teacher 
evaluation and cognitive student performance. The basis for construction of 
these instruments was sufficiently broad that usability should not be restricted 
to local or regional use. Further^ complete analysis programs are operational. 

The third area^ that of transportability of the process, may be limited. 
The specific processes varied somewhat among the sites and little formalized 
documentation of these. processes is in existence. The transportabl 1 i ty of 
this element will probably have to be accomplished through direct personnel 
contact. . . ' 
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SECTION III. RECOMMEMDATIONS 

The major goal^f this study was to conduct a third-party evaluation 
of thecarefer education model being utilized by the Minnesota State Department 
of Education, Division of Vocational -Technical Education. The evaluation 
concentrated upon the following eight areas: (1) design, 2) context, 
3) management, 4) instruction, 5) Information, 6) costs, 7) internal evaluation 
and 8) documentation and transportability. The major recommendations related 
to each of these areas are presented below. 

3,1 Design 

A. ESTABLISH IM ADVANCE AND COMMUNICATE SPECIFIC CRITERIA FOR 
:• EVALUATION OF AGENCY PROPOSALS. 

The state plan for vocational education specifies areas for 
proposal evaluation and evidence indicates that the Division 
of Vocational -Technical Education followed this plan very 
closely. However, there remains a need to specify ^specific 
criteria in advance; i.e., "weightings" of factors which will be 
utilized In judging proposals. Likewise, provisions should 
be Incorporated which will permit schools which are at an inherent 
disadvantage on certain factors (facilities, slz6, location, 
etc.) to have their special needs considered. 
^^4$. CONTINUE THE MULT I -SITE MODEL. 

_ j\ Acceptance bv the limited sample of the educational community 

{■ 

I examined by this study resulted In high acceptance of the 

multi-site vs. a single-site model ; I.e., multl delivery sites. - 
Evidence of problems encountered In the Instructional process 
also suggests that a single delivery site model may not have 
had opportunity to experience such a broad variety of needs, as 
that encountered by a mult I -site delivery model. If a 



geographical criterion was iitllized In selection of stte$» the 
Division of Vocatfonal7Technicai Educat Tort should give xoh- 
sideration to a si te in northwestern Minnesota as that ar^ea of 
the State does not have a current operat rona I exemplary care^lr' 
education project • ^ 
i^ROgiECT DESIGN AND IMPLEMENTATION SHOULD EMPHASIZE INSERVICE , 
TRAINING. 

Host individuals interviewed expressed ^the need for substantial 
in-service activities for-teachers and administrators. 
There was considerable evidence that the greater the teachef |n 
servicet the greater the amount of career education activities 
conducted both inside and outside the regular classroom* 
D. THERE EXISTS A NEED TO REVIEW GOALS AND OBJECTIVES TO DETERMINE 
CURRENT RELEVANCE. 

The listing of goals and objectivesin the original proposals 
have been revised. However » project evaluation has dictated 
some changes since that time. A current r'evfew of goals and 
objectives would offer additional ddcumentatlon as to the 
processes of these projects for other LEA'$'anticipating simi- 
lar ventures. 
Context ^ 

THE"CENTEKING''OF CAREER EDUCATION IN THE DIVISION OF VOCATIONAL 
TECHNICAL EDUCATION AT THE StATE LEVEL AND IN VOCATIONAL DEPART 
MENTS AT THE DISTRICT LEVEL SHOULD BE EXAMINED. 
According to -many conceptual thoughts ^vbtdtldnal education Is 
a part of career education and not the reverse • The admini^tra 
tloh of career education through the vocational departments 
both at the stdtet and local level have given a •Vocational" 
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{denttty to career education and |ajn4 educators see career 

education as part of a vocational Serog ram and not as a broad. 
Integral part of the total curr|cMlurri. 

B. THE PRIORITY OF. CAREER EOUCATtok AFFIJRDED AT THE STATE LEVEt 
SHOULD BE CONSIDERED. . jl 

Perception by many District personnel t especially administra- 
tors, was that verbal ly the St:at4 Department has given career 
education a high priority but»act|ton wise, the priority Is ap- 
parent ly much lower. General ly> LEA administrators were 
complimentary of the efforts of the Division? of Vocatlonal- 

TMhlHcaT^du^cattoh to further career educatlon-bttt-crl t^cat of 

other divisions of the State Bipartment for theLr apparent lack 
of plaeing career education «>s a high priority Itert, 

C. THE RESPONSIBILITY OF THE COMflMNlTY AND SCHOOL FOR THEIR / 
PARTS IN THE CAREER EDUCATION PROGRAM VARIES WITH COMMUNITf 
CHARACTE#IStlCS AND SHOULD BE "AMOUNTED" FOR IN FUTURE / 
PROGRAMS, - / 

The eight delivery sites have developed a program of shared 
educational responsibility between the school and the outside 
comnunlty. However, because of community characteristics, 
* size, occupational Information, etc,, generally smaller dls- 

trlcts (located In smaller comraunJ tJjssJ rtwst assume an 

Increasing responsibility for developing educational exp^lencelf 
which might normally be found In and assumed by the larger 
communities. 
Management ' 

A, THE PROJECT DIRECTOR SHOULD BE ASSIGNED TO THE POSITION AT 
. LEAST HALF-TIME. 
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Access to the project director Is. a very Important factor In the : 
success of the project. The project director must have time 
and a schedule that permits, him to be In personal contact with 
teachers » 

B, ENDORSEMENT OF CAREER EDUCATION SHOULD COME FROM TOP LEVEL 

LIME ADMINISTRATORS AT THE DISTRICT LEVEL. ^ . 

The priority of career education In a district as perceived by 
teachers la a direct function of the "visible" commitment 
given to It by top level administrators. In some fhstance$» 
other very worthwhile programs compete for top level endorsement 
and It Is difficult to establish a perceived high priority rieed 
< for career education. 

C. THERE IS A NEED TO REVIEW THE FUNCTION OF COMMUNITY STEERING •''•'^^i 

COMMITTEES. 

Many committees have been nearly Inactive and their contrtbutlfms 
to career ^ucatlon Is questionable unless their function becomes 
more meaningful. 

0. THERE IS A CONTINUED NEED FOR REVIEW OF GOALS AND PROGRESS OF 
THE PROJECT ON A PERIODIC BASIS WITH TEACHERS, 
This recommendation relates closely to (a) above as conttntious 
communication Is heeded between project management and teachers. 
CONSIDERATION SHOULD BE GIVEN BY THE DIVISION OF VOCATIONAL- 
tECHNICAL EDUCATION tO FUNDING PROJECTS ONLY IF THEY IMPLEMENT 
* A K-12 DELIVERY SYSTEM. Closely related to this recommendation ' 
ti the fact that Implementation of career education has encourtt- 

" * ■ 

ered considerably more problems at the seccindary level* In 
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this respect, some projects have concentrate?! greater 
resourcesat the elementary level than at the secondary level, 
and the Minnesota Model has shown a mucJv lesser extent of act I- 
vlty and products at the secondary level. 

3,4 Instructional 

A. THERE REMAINS A CONTINUED WEED TO MAXIMIZE COMMUNICATION AMONG 
THE PROJECT DIRECTOR, TEAdHERS, ApftlNtSTRATION AND THE 
COMMUNITY. ] 

This Is a "common sens|''ll'ecora'i>en<la<:'o" 3"** relates clpsely to 
recomnendatlons (a) and^(d):of 3.3, above.. Access to the project 
director Is vital for pbmmujjlcatlo^ 

B. THE INSTRUCTIONAL PRpG|/^, ESPECIALLY AT THE SECON'oARY LEVEL 
HEEDS MORE I NVOLVEMENtIaND "VISIBLE" COMMITMENT FROM PRINCIPALS. 
Support of the program: by principals Is a vital factor In Its 
success since teachers are directly responsible to the |>rl"c'pdl, 
the "tone" set by .the pflnclpjil Is a significant factor In 
Influencing teacher act tvlt lei. 

C. THE VALUE OF FIELD TRIPS AS TiIeY CONTRIBUTE TO THE PI^OGRAM 
SHOULD BE EXAMINED. 4fc * 

Most projects have utilized field trips extensIveT|. Teachers 
»and administrators generally report very favorable results. 
At least one project site has a|dl5trlct policy limiting the 
use of field trips and this tliwltatlon should be reviewed in 
light of the apparent success of field trips for other prol^ects. 
0. AN EXTENSIVE REVIEW OF THE TEACHER SELF EVALUATION AND STUDENT 
PRODUCT EVALUATION RESULTS SHOULD B? CONDUCTED. 
This review should Involve teachers and administrators and be 
related to the general direction of the career education program 
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of the district. The outcome of the review should provide 
a firm strategy for career educ^dion In the district. 
Information 

A. THERE- SHOULD BE A SYSTEM FOR THE '•AUTOMATIC" EXCHANGE OF CURRICU- 

'LUM MATERIALS, RESOURCE GUIDES, ETC. AMONG 'THE PROJECT StTES. - 
This raltfhf^e a'lcompl I shed with mailings but probably a better " 
method would be through the dlrectorsHneetlngs. Very positive 
reaction was given to the utility of the directors' meetings. 

B. MORE VISITATION TO PROJECT SITES BY DIVISION OF VOCATIONAL- 
TECHNICAL EDUCATION PERSONNEL SHOULD BE CONDUCTED. 

Both project directors and other adm^fntstrators felt that^greate 
-^ibntact at the local level by state department personnel would 
help to further their communications with the DVTE as well as. 
assisting the LEA In dissemination of project Information at the- 
staie level. 

C; AS A CONDITION OF PROJECT FUNDING, THE DISTRICT SHOULD AGREE TO 
A GIVEN NUMBEft OF MAN DAYS FOR DISSEMINATION WITH THE DIVISION OF 
VOCATIONAL-TECHNICAL EDUCATION. 

The Division of Vocational -Technical Education and the Districts 
receive frequent requests for Individuals to present Information 
about the activities of project sites. In some Instances, re- 
quests have become a i)U r dea-upon D I s t r ( c t-p^rsome ti»_espj£gLal 1 y 
some projector directors. If as a condition of acceptance of 
funding, the District and the Division could agree that a certain 
number of man days would be available fjj^r this effort through 
the joint approval of the District and the Dlvlsfph, many 
scheduling problems could be avoided. Closely related Is an 
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examination of District personnel practices In regard to local 
district policies for acceptance of money received for speaking 

engagements If such conflict with normal district employment 

pol Ides. , 
Costs . 

A. BUDGET RESPOtlSIBILlTY AT^D APPROVAL SHOULD REST WITH THE PROJECT 
DIRECTOR. 

This matter Is especlariy critical when one considers matferlal 
requests. These requests should be channeled through the project 
director ratheV than, or at least In add Utpn^ to the principal 
and business office. 



B. UNIFORM BUDGET AND COST CATEGORIES/SHOULD BE ESTABLISHED. 

If comparable cost data Is to be ibtalned for each project, there 
Is a need to establish uniform definitions. Currently, each 
project submits a budget according to Its own categories and 
comparablUty Is difficult. Instructional costs (federal money 
only) we're about $.16 per Instructional contact hour or about 
$^1.80 per class hour (30 students). The average cost to serve a 
student was-about $60 per year. This Included administrative, 
Inservlce, materials^ and other costs, but no local "In kind" 
expenditures. Cost projections were difficult and tentative at 
best and the reader Is referred to Part 2.6 of this document 



for a further discussion and qualifications of the above 
statements. 
Internal Evaluation 

A. CONtlNUE TO POOL INTERNAL EVALUATION RESOURCES. 

The rhonies devoted to Internal evaluation produced several trans 
portable evaluation Instruments and analysis procedures. The 
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- The quality control appl led to development and fmplementatlon 

- of this effort realized substantlatly greater returns than durJng_ 
•3^ the first year when each project was responsible for Its own 

evaluation. Only a coordinated approach to the evaluation 
process such as that conducted by the Reseg.rch Coordinating 
Unit at the University of Minnesota could have produced the 
In-depth evaluation Instruments and processes. 
B. DEFINE THE AREA OF INTERNAL EVALUATION ACTIVITY FOR 1973-7^1. 
In 1972-73 efforts •conbentfated upon Teacher Self Evaluation 
and Student Product Evaluation. Greater depth was accomplished 

In each of these areas than If pro;ects-fiad-been-^csi>ons4We-fOF- 

cvaiuatlon on an IndlvlduaHJ^^U^ However, whenever efforts are 
concentrated upon one or two areas generalized appfopjlateness 
to all eight sites i.a§ reduced and there Is d need to review and 
determine Internal evaluation priorities. 
C, REVIEW THE UTILITY OF THE TEACHER SELF EVALUATION. 

The data generated by this process should be put to greater use 
, by teachers and project directors in planning and Implementing 
career programs or the process should possibly, discontinued. 
In-service activities with teachers and the fact that feedback 
Information In this area will be readily available this year 
^PPl^-co„^^^4t^e-t€h^atei^sefiawt ss durln g_ the upcoming year > 



D. THE MAKEUP OF THE EXPERIMENTAL AND CONTROL GROUPS SHOULD BE 
EXAMINED. 

Preliminary results Indicate that no significant difference was 
observed between the two groups. In review of the evaluation 
design, the evaluation tWm feels that considerable confounding 
may be present In the two groups al explained In Section 2.7 of 

this document. i i o 
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* 








INVOLVE THE LOCAL COMMUNITY IH THE EVALUATION PROCESS. 


— 


■ - - - - 


Career education Is a shared responsibility between the schools 


•3 




and the cofumunlty and either thejnternal evaluation effort or 






the third-party evaluation effort should gather data from the 






community. 




3,8 Documentation and Transportability / 




A. 


THERE IS A NEED TO IMPROVE PROJECT PROCESS DOCUMENTATION. 






The evolutionary aspects of tn project can be very useful to 






Other districts contemplating such ventures. Currently, minimal 






process documentation Is available and responsibility for such 






has not been clearly establ 1 shed. 




$. 


THERE IS A NEED AT THE STATE LEVEL TO COORDINATE CURRICULUM 






MATERIALS PRODUCED BY THE PROJECTS FOR STATE-WIDE DISSEMINATION. 






£eKdiiX)f thet^jroject sites have produced various curriculum 






materials and have disseminated those to varying degrees. The 






state department has disseminated On a state-wide basils materials 






An^^ f f 4*i^A * Wf\\^ti\»i>r* f:hi^f*t4 ^t^tt\7\\T\^ A need to Examine all 






materials produced by the eight sites and eliminate duplication. 






' Index^ remove localization of materlalSi etc., and disseminate 






as a total product both within Minnesota and othef states. 




C. 


IMPRESS UPON INSTITUTIONS OF HIGHER EDUCATION THE NEED FOR 


-- " 




CAREER EDUCATION TRAINING PROQtvftnS. ■-.r— ^ -^...^^-^^—.-.-..^ — — 






•<A number of the project sites have made arrangements with 






* higher education Institutions for In-service courses usually 






located at the project slte^^j^cher reactions- would suggest 






that some form of career education training should be part of 


• - 




every teacher -preparation program. 
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APPENDIX A 

APPENDIX A CONTAINS A CONDENSATION OF THE aUE$TIONS ASKED OF 

mToosntmh^^DW^^-wlVW6-T^ of site visits. 

QUESTIONS WErI DIRECTED AT PROJECT mRECXpKB, SUPERINTENDENTS, 
PRINCIPALS AND RANDOMLY SELECTED TEACHERS AND WERE ASKED VIA 
PERSONAL CONTACT BY A MEMBER OF THE EVALUATION TEAM.WlTH 
EXPLANATIONS AND DISCUSSION PROVIDED BY THE INTERVIEWER. 
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THIRD PARTY EVALUATION OF THE CAREER, EDUCATION MODEL 
FIRST SITE VISIT INTERVIEW STRUCTURE 



r 



PROJECT DIRECTOR 

1, Review of prW»osal; noting goal statement and changes of emphasis. 
2 List or extract from proposal the products to be generated and timeline. 
3, Obtain and review any evaluation of the project - Including State Depart- 
ment visitation reports and correspondence. 
k. What type(s) of service Is being offered? 

5, How are these programs affecting students? 

6, What evidence do you have (or will you have) relative to student-centered 

outcomes? . u ^ 

7, How did you determine the tnservlce needs of the teacher/ 

8, What type of Inservlce was provided? 

9, What Is your perception of teachers' reactions to: 

1^ Tnservtce- 



2) The project In general 

3) The RCU ' ' 
V) The State Department 

10, What Is your personal assessment of the success of: 

n cirrkulum^development 5) Fad 1 Ity appropriateness 

2) Budget control 6) Products , . 

3) Communication 7) Student evaluation 
k) Staffing quality 

B. The RCU's efforts to evaluate the project. 

SUPERINTENDENT (or other district level administrator) 

1. How does this project relate to the goals and objectives of your own 

2 How°wtll^your'^project serve as a demonstration model to other districts? 
t. The State Department of Vocational Education has chosen to fund several 

projects (smaller financial support to each project), vs. one Project 

(greater funding to a single project). What Is your reaction to this decision? 

h. What Is your personal assessment of: 
A. The Project 

B^,-!Ffae-RCU's-ef forts to evaluate the project 

5. Do you feel that the project has been well communicated at all level sf 
PRINCIPAL 

U How do the goals and objectives of this project relate to the learning 
goals of the district and of your own building? ^ 

2. What Is the perception of your teachers relative to the Impact and value 

3 What*^proMemrhas your school encountered In Implementing the project? 
H. What successes can you Identify as a result of the project? 

5, Do you feel that the project has been well communicated at all levels? 
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TEACHgR . 
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1. In what ways have you been Involved with the Implementation of the Project? 

2. Ourlng'-your daily contacts with students, how are you. "delivering the 
goals and objectives of the project? ^ . . o 

3. How much of an Impact have you (and the project) had upon students? 

I: The RCU Isxonducting an evaluation of each project. What contact have you 
had with the evaluatlon.effort and what iffpact do you see the evaluation 

5. pryou^-eel that the project has been^well communicated at all levels? 

• . THIRD PARTY EVALUATION OF THE CAREER EDUCATION MODEL 
SECOND SITE VISIT INTERVIEW STRUCTURE 

1. ' How were t?/chers Involved: (\) Did size of school make aTlff^ence; - 

(2) Did freedom of Director make a difference? - • 

2. How should the Project Director be selected? Who should he be? Who Is * 
most likely to succeed? , , . 

3. What Is the effect of In-service training? Does It make a difference? 
Does It get teachers Involved? ^ u u « - 
What do administrations feel the value of the project should be for 

5. ^%lTknoL of strategies which are most likely to work? Initiating 
project? Involving teachers? Motivating students? 

6. What kind of report formats do you view as Important? ,„^^„„V7 
7! What Is your appraisal of the RCU's efforts? How can the RCU Improvk? 

Hgve you changed your approach because of these reports? 
8. Do the! projects have a self-increasing effect? , ..^ 4...^.«i.c7 

9 What aVe the goals and objectives which you are "delivering" to students? 
10. How much of an Impact have you (and the project) had on students? 
n. How weri classrooms selected for experimental and control groups/ 

Random? What students were chosen and how? 

12. Are students likely to be Instructed In two different places and 
tested as being In one? 

13. How many students are In each group? 

Ih. How will tests be scheduled? . « . v «.^9 

15. How can you get percentile ranks for I.Q. and Achievement tests? ^ 

16. What Norm, will you use? 

- CHECKLIST 

1, List of products and processes' 

A. Workshops and In-service 

1) Number of teachers served 

2) Amount of time spent by teacher 

B. Curriculum materials - manuals, etc. 
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APPEMOrX A (ContJriied) 

si. Number of tea|!hers and students served 



Grade t 



3, Federal money spent on: 
A. Admlnlstratfon $ 
B* In-service $ 
C. Materials $ 

&i AH-Other 



If of Students 
K 

through 
12 



# of Teachers 

through 
12 



TOTAL 



$ 




A SYSTEM FOR EVALUATING CAREER EDUCATION 
^ 1^ MINNESOTA; 1972-1973 ' 

* A' Final Report 

Submitted to the 
State Department of Education 

Division of Vocatioftal and Technical ipducat ion 

Capitol Square Building 

St. Paul, Minnesota 

-. . • . ■■ ■: ■ ; . ■ ■ ■ ;'t^i ^ . "-' - - ■ ■ - ' ' ' ■ 

JRtrepared by 
Brandon B* Smith 
, Minnesota Research Coordinating Unit 
for Vocational Education 
University of Minnesota 



February 1974 



124 



ACKNOWLEDGEMENTS ' 

- ■ ■ ■ f • ■ ' ? 

" ^^The ©embets of the staff of the Minnesota Research Coordinating Unit for 
Vocational Edtication and the Division of Vocational and Technical Education, 
State iDi^partment of Education vish to take this opportunity to express their 
appreciation to three gtoups of Individuals who participated and/or cooperated 
tn the conduct of these evaluation^ studies. 

First, we wish to recognize the cooperation that students, teachers^ and 
directors in the exemplary projects d:ejionstrated ,by providing the lata used to 
develop this report. While it is not possible to list all of the individuals/ - 
in th e exem plary projects, we would at least like to recognise the direc^ " 
of each of the eight exemplary projects: Donald Barber^ Gwatontia; Robert Olsen, 
Osseoj Pete Martens^ Red Wing; Jerry Johnson, Plainview; Donald Kellen, Willmar; ^ 
Dale Abbott, Gloquet; Vernon Vick, Roseville; Ronald Johnstone, White Bear Lake. 

Second, we wish to give special recognition to those studetits, teachers, 
and especially the principals of several schools who cooperated in the evalua^ 
tion even though they were not formally involved with the career education pro- 
ject. The principals of these school?, deserve special recognition for the pro- 
fesiSlonal way in which they cooperated with the project: Mr* Dennis Deanovic, 
Fatibault Elementary jgchool; Mr, Robert Hall, Fatibault Junior High School; 
Mr^ K6nneth Prihoda, Hutchinson Elementary School; Mr. Ralph Bergsttom, Hutch^ 
Inson Junior High School; Mr. Virgil Gteen, Zumbrota Elementary School; Mr. Richard 
<Jhi taker, Zumbrota Junior High School. 

Last» we wish to acknowledge the cooperatiori of various business and in- 
dustrial agencies who provided materials that were vital to the development of 
the caireeic education tests: Leiner Publications, Minneapolis; Greyhound Bus' 
Compatty, Minneapolis;. U. S* Bureau of Mines, St. iPaul; U.S, Department of Com-* 
fiierce, St. Paul; U. S. Department of the Interior, St. Paul; U. S. Air Force, 
Minneapolis; Northwest Airlines, St. Paul; Anoka Vocational Technical Institute,*, 
Ahbka; MayO Clinic, Rochester; Minnesota Mining and Manufacturing Company, St; Paul 
Ford Motor Company, Chicago. 

' it is aAtlcipated that more than 20»000 individuals participated in and 
devoted cotiSiderable amounts of time- to th^ evaluation ptoject . It would not 
have been possible to develop and operate the evaluation system without this 
tyi^o of professional couttibution/ * 



ABSTRACT 



Introduction 

The state of Minnesota used Its funds designated for career education to 
support eight (8) school districts in the itnplejnentation of career education. 
Each school district proposed a different way to implement career education, 
the purpose of this report is to present and discuss the findings of the, first 
-year's evaluation of seven of the participating projects as they relate to 
(a) the processes teachers and project directors used to iinplement career ed- 
ucation and (b) the impact that career education instruction had on the cogni^ 
tive achievements of students. 

The~?llnnesota Researcfi~1Coordinating Unit for Vocational Education designed 
and operated a system of formative and suimnatlve evaluation to assess the pro- 
cesses used to Implement cartL.er education as well as assess the Impact that ca- 
I 1 . reer education instruction 'had on students in grades 1-9* The findings of the 

study are presented and discussed separately for the formative (Part I) and 
summatlve (Part ll) evaluations. These sections are followed by a general dis- 
ctissldu Of both sets of findings (Part III) • / 

Formative Evaluation of Instructional Processes 



/ i?wo self-evaluation forms were developed to obtain information from and 
provide continuous monthly feedback to the project directors and participating 
teachers in each of the sevtri exemplary projects concerning the processes they 
used to implement career education. The project directdrs,j|^ported the type 
and amount of support activities conducted each i^^onth and tecelved a cummula- 
tlve summary of these activities from the Minnesota ECU. jAch parjticipatjng 
teacheir ^*descrihed" the type and amount of time spent on c^areer educaCiBn/ in«- 
Atructlon conducted each month using a specially designed form set up ^r op- 
tical scanning and computer analysis. A one page, computer Summary report of 
tihese instructional activities was provided to teachers and project directors 
perlddically during the academic year, Th^ purpose of these data was (a) to 
obtain baseline information about the methods used to Implement caig^^^r educa-' 
tion and (b) to detect differences 'that may exist among the seven projects in 
terms of implementation strategies. 

Based on the data provided by project directors and teachers for a seven 
indnth period, the processes used to implement career education in the exemplary 
projects may be described in the following manner: 

1. On the average, a project director devoted about seventeen percent 
of his time to administering, supervising, and planning career ed- 
j|ication activities* These activities included (a) attending and 
tiiakltig presentations at twenty locals state, and national meetings,- 
(b) preparing and distributing .about eighty different pieces of 
prdtnotlonal inforttiation about career education, (c) providing in- - 
service training for about 350 teachers, (d) purchasing and developing 



l^^j^ about 300 different curriculum or Ins-tru^tion materials, and (e) 

'"I^P^' ■ V . , organi:jltig career guidance servicest f or 450 teachers and 3200 

students^ 



Teach^rd, on the aiverage^ sp^nt about three percent (2.43%) of 
their ^llne^'(abo^ hours a inpnth~o1rH:v5 hourj^^ w^ek) 

conducting twenty (20) separate activities related to' career 
education that (a) were integrated with their regular course 
content, (b) consumed (on the average) about thirty-five (35) 
houts of instruction and ptepariation time, and' (c) emphasized 
4:htee major concepts related to career education (self-aware- 
ness, occupation industries, and work roles) and (d) utilised 
a range of instructional techiilques to Implement career edu- 
cation. The most frequently used techniques iwere those that 
could most readily be used in a c^lassrdom (e.g. A^V presenta- 
tion, presentation^-'discussion, workers in class, career games, 
etc.)* 



\The instructional protiie described Is based on data obtained from ail par*^ . 
tlclpating teachers and^ .as suchj represents, the average prof ile> Additional 
analysis of the data showed that each exemplary px-oject differed cotislderably : 
in terms of the way in which career edticatlbil was Implemented. 

Sonie of the largest differences In Instruction were in tetms Of: (a) The ^ 
type and amount of emphasis' on support services (e.g. counseling ^ in-service 
training, and promotional activities, etc.), (b) the number of instructional 
activities conducted i (c) the amount of. instruction and preparation time de- 
voted to career education, (d) the frequency with^whlch in$trvtetional techniques 
were used, and (e) the amount of instructional time devoted to vatlous Instruetloiial 
techniques. It was apparent that teachet^ within each project uded a wide range 
of instructional techniques which were integrated with their regular course con- f^^"^- 
tent to Implement career education, but dt was also apparent that teachers placed 
less instructional emphasis on the concepts of work requirements, career decision 
making and occupational levels than they did^on other areas of content. ^ 

It may be concluded that the seveti^ exemplary ways projects did, in fact, 
implement career education in different ways; they utilizted different ins true- . 
tional techniques, they differed in the average number of activities conducted, |^ 
and they distributed the ^&unt of instruction and preparation differently \ ■ ii. 
morig th(i activitl^ conducted* It remains to be seen whether these instruction- 
al differences have a, differential impact o% the subsequent aohievements of their 
students* 



Summative Evaluation of Student Achievetnent 

Students in both experimental and control groups were administered specially 
developed career education tests designed to assess the impact of career education 
on their cognitive achievements. Experimental and control groups were identified 
by th6 project directors or by principals of schools > as groups of students vho 
had and had not received formal instruction in career education respectively. 

The putposes of the study were to determine whether (a) the career education 
testa were reliable and sensitive to differences among grade levels in terms of 
student achievemettt, (b) there were dlffe'rence^ between matched groups of exper- 
Itfeentai and control groups in terms of student achievement > and (c) there wera . 
diffetences among the s^^ven exemplaty projects in terms of student achievement. ^i^^ 



a- 



— - Analysis af—tJie -data-rave;slM^^^^^ — — - 

1* The tests Were equally reliable for both experimental and control 
groups, but the 4-6 and 7-9 tests were' ©ore reliable than the 1^3 
test. * u " 

, 2. The tests consistently detected relativel^iT large differences asong 
grade (maturity) levels for both experlinental and coiittol groups* 

^ 3. Differences in student aehlevetnent were detected for experitaental , 
and control gtoups, but the^e differences were generally very 
suiall and not always in favor of the experliuental groups* 

— irv — Differences in student achi eveme nt we re-d etected among the seve n — 

experitnental projects ^ but those diffe^rences were generally quite 
. small and not consistent atuong grade levels. That is, achievement 
scores of students at certain grade levels were higher^'than those 
of students in other pro^cts, but the opposite was tr^tie at other 
grade levels. ' , 

These findings suggest that (a) the testa were reliable and capable of de- 
tecting differences where^ in^ fact, differences exist, and that^(b) the relative 
liapact of career education instruction on tlie cognitive achlex'ement of student^ 
was small and not educationally significant.. 

U 

Interpretatlan/Flndlngs 

Four plausible explanations for not finding larger differences in the mean 
scores of students in ejqperiraental and control groups or among the students in 
the exemplary projects were discussed. First, it is possible that the tests did 
not adequately sample the content emphasi:sed by teachers in the exemplary pro- 
jects. Second, teachers in the control schools had perhaps been teaching career 
education concepts and thus, had an instructional program \simllar to teachers in 
the e>:eroplary projects. Third, the amount of instructional etophasis and time 
devoted to career education was inadequate (1.5 hoi^rs per veek) to make an im- 
pact on the cognitive achievements of students in the eicemplary projects. Fourth, 
one year of career education instruction may be insufficient to demonstrate ob*- 
servubla^^ changes in the cognitive achievement of students. The findings also may 
suggest thdt integration of career education Concepts with regulat course content 
may no t be the best instructional strategy for impactittg student achievement* 
Additional research and evaluation of the instruments .and Instructional strategies 
are needed to provide answers to many of the questions suggested by this report. 
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A SYSTEM -FOR EVALUATING CAREfeR EDUCATION 



IN -MINNESOTAi 1972-1973 



Forward • , , . 

, thci state of Minnesota, for the 'past three years> has received federar ftmdg 
authorised uridet Part C of the Vocational Education Arcendments of 196'8 to support 
-4emttB4:4r^ion-^^rio4ec^s--li^-C5^ — Sbes^f4md^i 
li^h> develop and Itiple^ent career education in eight different school districts 
which currently serve as demonstration sites for other schools in the State, 
Because one of the schools dropped out of the" project and was replaced by another 
school^ only sever! schools partlcipltted in the evaluation processes. 

Each of the seven sch<)ol dlstticts vas selected on the strength of its pro- 
posal arid the unique way in which it planned to itaplement career education* It 
was perceived that the seven site ihodel, together with a comprehensive system of 
evaluation, was the raost effective and efficient strategy for ob tainting empirical 
baseline information about prograijuiaatic efforts directly related to the implement-- 
ation of Ciireer education. 

The Minnesota Research Codrdlnating Unit for Vocatiottal Eclucation (RCU), 
located at the tiniversity of mnnasota, in cooperation with the directors of the 
^career education projects and the Vocational Division, State Department of Educa- 
tlonji was given the responsibility to develop a cotfiprehensive^ system of formative 
and suiamative evaluation* The purpose of the evaluation was to prbvide empirical 
data to various groups of decision raalters at the local and state level iri order 
that both the quality and quantity of career^ education could be eiichaiiced. 

The purpose of this report is to present and discuss the findings of the - 
first year's evaluation of seven career education ptojects^ in Minnesota ♦ The 
report Is divided Ittto three parts*. Part;^! pertains to the '^processes'' used by 
each of the seven school districts to itii|>lcment career education concepts. Part 
II presents in£orinati6n concerning the "product'* outcomes of the projects in terms 
of the cognitive achievetnent of students cdncerning concepts related tp the world 
of* worlc. Part in describes the rela€lotiship between the process and product 
evaliiatiotis in tetms of the relative impact the programs had on students* 
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PART I 



A SifStEM OF FdRl-IATIVE EVALUATION OF THE PROCESSES 
USED TO IMPLEMENT CAREER EDUCATION 

INTRODUCTION 



A coniprehensl\''e system for evaluating developmental projects In career 
education must provide inforination td various groups 5f decision -makers (e.g* 
teachers, local project directors, state departiaent peraormel) coneenring both 
process and product outGoaes". In the early stages of development, it is important 
^Q^tle velQp 3 r-By^t^tm-o§-^ which provides exa p ir i cal inforn^atidn — 

about th^ quantity and types of •*praeesses'^^ used Jto implement career education. 
Forcative evaluation implies a systematic process, of providing local decision* 
loakers {project directors and teachers) with relevant inf^^rmation such that 
itmuediate changes may be made in their program* ^ ^ 

The purpose of Part I of this report is to d,iscuss the system used to 
conduct a f ormati\''B evaluation of the processes' used to itiiplement career 
education in th^ seven different school districts and descriptively compare 
the career education projects in terms of the types of activities and amount 
of time each devoted to career education* The objectives of the study were: 

(1) To determine whether there were differences among the seven career 
education projects in tetxm of the type and/or relative apounr of 

support service activities » 

« * 

(2) To determine wh^^ther there were differences among the seven career' 
education projects in terms of the (a) number of career education 
activities conducted, (b) type of curriculum organisation, (c) 
amount of time devoted to instructidn and (d) content emphasis* 

(3) To determine whether there x^ere differences dmong the seven career 
education projects in terms of the types of instructional methods 
used to implement career education, 

PROCEDURES 



Instrument Development * 

• * » » 

Two separate seljL^valuation instruments were u^ed to obtain information 
from (1) the project ti«fec tors and other support personnel and (2) teachiBrs who 
were participating in the career education project. Data were collected each 
mnth for the last seven months of thfe 1972-73 school y^ar* 

Dlseusstcne with the directors of the seven career education, projects and 
oelected staff from th^ lUnnesota State Department of Education were conducted - 



132 



in the spring; df 1972 for the purpose o^f developing an effective and effidiaut \ 
system for cbndueting a fotmative evaluation of the processes used to impleiiient 
career edueatidn. The requirements of the syatem included the fallowing concerns: 

(1) t the'ltn^truments used should he fdinprehensive, and require 

Bttniinal time to complete* 1 

■ - " ^ - ■■■■ ■ . ■ ^ ' ■ .. ■ - ' ; . 

(2) The system should be capable of providing feedback to local 
directors and teachers on a tnonthly and/or quarterly basis. _ . . . 

(3) The system should be capable of aggregating data by project, 
school, month, grade level or curriculum area. 

— (^ 4) Th e tut- na round ti m e-fornpt^viding-^eed ba should be t irf^nimal — — y- 

(onc to tvo veeks) . - 

One\nstruiaent was designed to oBtain inforruatlon froni local &£oj6ct directors 
and bthei* support personnel concerning the type and amount of services they provided 
(See Appendix A) . The types of services were classified in the following manner: 
(1) general administrative duties, (2) promotional activities, (3) curriculum and 
instruetional materials, (4) in-service training activities, and (5) counseling 
and guidance activities* Data were collected from directors each month for 
seven months. Both monthly totals and cumulative totals were recorded on separate 
fogps by tlie staff of the Minnesota RCU and returned to directors each month. 

An alternative Sitpatpgy had to be used to obtain descriptive information 
about career education activities from" teaehera. A self -evaluation fotra waa- 
designed which would be non-threatenlttg to classf obra tcachera. -Because of "the 
tclatlvely large 'numbers of teachers involved (about 500) an efficient system 
of' data collection and analysis had to be developed* Consequently^ a form was 
developed iti which the data could be read by optical scanning equipment and 
analysed by computet?. , ^ . ^ ^ 

The staff of the Minnesota RCU met with several teachers and project directors 
during the sunacer'of 1972 for the purpose of identifying and classifying (a) the 
various types of instructional methods most frequently used to teach career educa- 
tioil poncepts and (b) the content areas related to career education. By referring 
to the rationale and model for career education developed* by the staff of the _ 
-Minnesota RGU-, a proto„type of an optical scan Instrument , which Incorporated most^ 
of the ideas, of the teachets and directors, was developed and pre-pilot tested wa-tn 
about one hundred (lOO) teachers. 

The final form of the instrument was developed by the staff of the Minnesota 
RCtJ With consultation from the staff at the University of^MinnesOta, Student 
Counseling Bureau, and printed in booklets containing twelve (12)M1" x 17 forms 
which could be easily removea from the booklet (See Appendix B)'. Each fotm provided 
teachers the opportunity^o^'Mescribe" "twenty different instructional activities- 
each month simply by darkening the appropriate circles. Teachers were directed 
to complete the fotm immediately after an activity had been conducted and return 
It to the project dltector at the end of each month. 

: - The IttStrumetit was divided into three parts, the first i^art contained 
teacher identification information (ptoject, school! and teacher codes, grade 



levfi}.* number o£ students, month anS curriculum area). The sexsond part 
contained Inf^irmatlon about the amount of preparation and instructiS#- time 
in relationship tot (a) thirteen different methods o-f instruction and (b) * , • -~ 
thtee type^ of curriculum organisation. In addttion, teachers were asked to 
indicilte the number of students who received instruction and evaluate the '~ - 
activity in terms of , student interest ot motivation. The last part- of the , 
form allowed teachers to Indicate the content emphasis for each instructional ^ 
activity and the amount of time required tO "describe" each activity. 



Special optical scan programs were developed by the staff at the Student 
Counseling Bureau to "read" the data on each form. Data were read by the optical 
scanner and written to a magnetic tape. A series of four specially developed 
computer programs were developed t? analyze and summarize the data into a one 
page computer' table (See Appendix C), Data could be aggregated for any combin- 
ation of the six teacher codes (project, school, teacher, grade, month or curric- 
ulum area) which appear on the form in terms of "totals" or "averages". 



The forms were collected and edited for accuracy and completeness by each 
proiect director or his desigttate at the end of the month. Forms were then sent 
to the Minritesota RCU and scored by the Student Counseling Bureau. Data were 
edited by speclAl*^ computer programs, corrected by the staff of the RCU and then 
rc-dcored. Rata were accumulated for each partlcipatiftg teacher for seven acaf 
demlc months.. 

Teachers and project directors were provided with computer printouts at five 
different times during the year* Tlie first analysis summarized three months of 
data (October - December) . Separate printouts w6re provided for the month of 
January, Tebruary and March. The last set of printouts summarized all seven ^ 
months of data and provided totals and averages for each of the following categories: 
(1) project, (2) school, (3) 'teacher, (4) grade and (5) curriculum area(s). 



■ k total of seven different school districts participated in the process 
evaluation. (One school was aiminated from the evaluation because it was 
placing emphasis on in-service training and curriculum developtnent rather than 
engaging in Instructional processes*) These are designated in the report as 
projects 01 through 07 respectively. There was a total of 498 teachers who par- 
ticipated In the project r 325 elementary teachersj 110 junior high school teachers; 
13 senior high school teachers. Table 1 shows the nutBber of teachers by grade 
level and project who ..participated/ in the process evaluation. 
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Table 1 



Project " Elementary Junior High Senior High Total 



Total ' . 3?5 . 110 13 498 



The project director, ^through a sferlca of in-service workshops , Identified 
the teachers within his project who were to participate >n the evaluation. , ^ * 

Each participating teacher wis asked to complete a biographical data shedst 
(See Appendix D) . This -information is summarized in Table 2. A total of 4S2 of 
the sheets were received which repteaented about a ninety-one percent (91%) . 
return. A^rcra'gea or percenta are'bjsised on only the teacheifs who returned the. 
fbrn find are shova separately for ej^ch project' and for the total group, of teachers. 

The average teacher who participated In the career education project had 
(a) taught for mout nine (9) years, (b) two (2) yeats of non-teaching 
work experience .nd (c) been out Of high school for about sixteen (16) years. 
A majority (68S) received their education within a comprehensive high School ^ 
curriculum while relatively few (2%) studied in a vocational high school. 
Approximately three-fourths of the teachers were raised In either a small 
town or rural atea and the other one^f our th wete raised in cither a urban - 
or suburban atee. Most of the teachers (84%) had only a bachelor's degree; 
relatively few^ (16%) had any work beyond, the bachelor' a degree. 

. The characteristics* of teachers In each of the projects seem to be o.ulte 
alinilar. two cf the projects . (.02 and 03) may have a slightly younger staff 
than the other projects? the staff in three projects (01, 02, and 04) seem to 

- • • 13!) 
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NmffiER OF TEACHERS BY GRADE LEVEt WHO PARTICIPATED H 
IN EACH OF SEVEN CAREER EDUCATION PROJECTS . 



I 



01 8 13 12 33 

02 15 7 — 1 23 i e i 

03 113 : -~ , \ — 113 * • 

04 21 ' 23 — • * .44 

05 ' 122 67 . 189 - ' . f 

06 57 — — ' 57 

07 39 — — 39 i 
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Table 2 



SUMMARY OF TEACHER CMlli\CTERISTlCS FOR 
EACH CAREER EDUCATION PROJECT 



Chatacteristics 


01 


02 
N=ll 


Projects 
03 04 OS 

11^106- Hs32, N^-ISA 


06 
N=56 


1 

07 


Totals 

Average 
IW2 


. , . 

Average JTears of TeacViing ! 


10 


7 


v! 


10 ! 


10 




10 


9 












■|-r..j.. ^ 1 ■ ' , J 1 < i 1 ■ - ■ ■ 1 ■ 1 

Avi^rage Years of Work EKperience 




3 


• 1 . 


3 




1 


1 


1 

' 2 .. 


■ .. * I, 

Average Years Since High.^Sch©Ql Orad.jlS 


. 14 


13 


16 


16^. 


13 


22 


J 16 


"HigK School Currlcalu©^ 


















General Currieulum 


36?i 


i 9% 


.33% 


34% 


40% 


25% 


33%- 


30% 


" Cdmprelien0lv0 Currle-ulum 


58% 


I 917. 


'66% 


66% 


58% . 


' 73% 


67% 


68% 


Voeatlonal Curriculum ^ 




• 0%, 


1% 


Q% 


2% 




1. 0% 


' 2% 


Curr,ent degree 


J 












! 




Percent B.S. 


126% 


' 82% 


54% 


34% 


37% 


34% 


i ■ 73% 


, '^9% _ 


Percent 1.8.4- 


'29% 


181 


42% 


47% 


39% 


50% ■ 


: 23% 


3 5 


Pereeht M.S. 


\u% 


0% 






10% 








Percent 


'.31% 


OS 


0%* 


9% 


15% 


4% 


\ 0% 




Percent Ph.D. 


1 0% 


■ 0% 


0% 


0% 


0% 


0% 


' 0% 


■0% 


Residence - 








t 










Percent Rural 


'^19% 


27% 


*34% 


28% 






' 30% 


2?% " 


Percent Small Totcn 


57% 


3,6% 




53% 


48% 




. S"7% 


4b% 


Percent Urban 


'22% 


■ 18% 


8% 


16% - 


16% 


21% 


f 10%' 


- .16% 


Percent Suburban 




18% 


11 


3% 


7% 


34% 


3% 


11% 


In-Service Training 


















Average t^umber. of Field %tipB 


5 


3 


2 " 


2 




1 ' 


1 1 


2 


- "Average Kumber of College Credits - 






.4 


• ** 


1 


.3 


.4 


1 ' 


Average Kui^ber of lid'urs in Workshop 




27 


1 


IS 


7 


2 


: 1 


12 


-Avetam Kumber of Hours, in Meetin^^s 


5 


"s 


2 


13 


6 


i 


• 1 


'5 


Curriculum Development Activities 
Percent Participating 
Percent liOt Particlpmtiitg 
Average .Nurober of Hoihrs in 
Activities * \ 


42^^ 
23 


i '27% 

: 73% 

1 

1 

1 24. 


9%" 
91% 

^8 


13% 

69% 

1 

' 51 . 


1 

' 88% 
1 


4% 

96% 

2 


10 

; 90%: 

; C 

I \4 


^ 20% 
80%' 

16 _ 
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have had, more work esqierletice* A higher percent of teaohers in one project (02) 
participated :in a .comprehend high school cur riculnm than wa$ the case in the 
other projects ^ /pnl^^ have more teachers who had 

participated in a secondary vpcational curriculum than the other six projects. 
Alsoy regatdl^s of school district location^ most of the teachers in each pro- " 
ject wiere raised ^i^^ a small town or rural community. i 

Oa the aiyer^ge , each teacher had (a) a bachelor * s degree , (b) participated 
in two (2) fiel^ (c) obtained college credit for one or more : 

career education courses, (d) twelve (12) hours of^ experience' in career educa-- 
tidn wo^ devoted about five (5) hours to career education meetings 

In additioilv about twenty percent (20X) of \the teachers aveyaged ^sixteen (16) 
hours of tiice developing curriculum^ materials related ^ to career education ptrior 

There appear to be some dif£erence$^ among projects in terms of the teachers' 
prior involvement In. car^ activities . Teachers in three 

projects (01, 02, and 04) appear to have been involved in iiiore workshops and 
meetings than teachers in the other projects. Two projects (01 and 02) had inr- 
voived a higher percent of their staff in the development of curriculum mater- 
lals than the otlaer five projects* ' 

In general^ it would appear that the teachers who participated in the career 
Education project had a rather limited work experience (excluding the teaching 
prof essipn) . It also appeared that the directors of the projects recognized this 
fact and attemi^ted to provide a variety of in-service training activities to com- 
peneate for this, lack of experience. . 

- Validity and Reliability of. Data 

Because the findings and conclusions^ of this report are dependent upon 
obtaining valid and reliable data from teachers, two separate analyses of the^ 
scoring sy steel were conducted. The first analysis pertains to the effective- 
nefes and efficiency of the scoring system and the second pertains to the accu^ 
racy: of the data as perceived by the teachers who participated in the evaluation 
process. A summary of this evaluation Is^^^afiQ^wn in Appendix E. 

' 'y' : ^ findings . : ,. r:'^ 

: Objective #1 ; . .'-'^ /' " V' - ' ' 

■\ to determine whether there were differences among the career 

education projects in terms of the type arid amount of support 
■ #ervlcee activities conducted* \ - ^ ; / . ' 

V Mkdi p£ the ^even project directors, together with support personnel (e.g. 
iouttselots , librarians , media specialists, etc.) was provided "self-evaluation" 



form to be completed each month • The form requested information about the type 
and amount of effort devoted to (a) general administrative duties, (b) promotional 
activities (oral and written) » (c) instructional materials (purchased or developed), 
(d) in-service training activities, and (e) counseling services. 

Table 3 shows the totals and averages for each item on the form by project. 
A sum^aty of the findings shown in table 3 are as follows: 

1. : The averiage time devoted to general administrative duties was 
249 hours for each project director with a majority of their 
time devoted to project administration-supervision. The 
Ifeadt amount of time was devoted to evaluation and miscel-- , 
laneous activities* Based on a school year of 180 d_ays . 
(144(j hours), project directors sp^ent about seventeen percent 
of their time administering the project... Three projects (01^ 
03, and 03) reported that they devoted about twenty-seven per- 
cent (27%) of their tirae to project admiiiistration, 

2. During the year, a total of 137 oral presentations about career 
education were made to variou?3 groups of people (average of 
twenty (20) presentations per project) but mostly to local 
school board. members** T^Jhile most of the presentations were 
made to groups of people within the community^ it is interesting 
to note that several of the project directors made oral presen- 
tations at state and /or national convent ioiis and to other non- 
local groups. 

Each of the seven career education projects dis,seminated, on 
the average j 78 different pieces of written materials (total 
of 5A3) to promote career education. Most of the materials 
were in the form of newsletters, books, pamphlets, or miscel- 
laneous materials. It seems apparent that some projects (03, 
05, 07) placed more emphasis on developing promotional mate- 
rials than did some of the other projects. 

3. The seven projects purchased or developed a total of 2053 instruc- 
tional materials (an average of 293 per project). A majority of 

I the materials were (a) printed materials or J^ids, or (b) resource 
guides. . 

4. A total of 2,443 and an a^C^erage of 349 individuals per project 
attended a Vide range* of /in-service training activities. The 
'most frequently used in-service techniques were (a) in-school 
sessions, (b) extension classes, (c) formal workshops and (d) 
occupat^Lonal field trips. It also appears that some projects 
(03, 04/ 05) placed more emphasis on in-service training than 
did the other four projects. 

5; A large huniber of students received some type of career education 

counseling services. Most of the students (a) made use of a career ^ 
education library, (b) attended spec^ial guidance activities or (c) 
received itidlvidual or group counseling* Wvile it is apparent that 
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Table 3 



CUMUIATIVE SUl-lMARY OF SUPPORT ACTIVITIES IN GASEER EDUCATION 



Activities 



'^^ii AaminiatratAve Duties (Nuiaber of Hours) 
'Ceaeral Project Adtninistration-Supervision 
tk'kiuring Inforraation and/or Consultation 

'Ttterid Non-School Career Ed. Meetings 
I^ruject Evaluation 



*Total 



Oriil Preiseritations 
s>jts.unity and/or Social Groups 
. Ji^cupatlonal or Advisory Groups 
tetetti Siihool and School Board Personnel 
?;Cia-^Local Presentations 

t'^tesentatiotts at State or National Conventions 

■Other ■ . 

Total 



■M. Ulf Cerent Promotidnal Materials Disseminated 
Sfewa tetters" - 
I'rdject Reports 
Visual Displays 
Boakletsf or- P$ffii>hlefcs 
i-t£i,ifs Media Releases 
■Other' ■ ■ ^ - ^ ■. 

-. ' . . . . :- Total 



of Ittat. Materials iPur chased of Developed 
IVtlnttid Insticuttional Materials-Aids 
Audio-Visual Materials 
feesc'urce Guide or Study 

'Wpt;a?^»efer^ce9^~'~ " ' ' " 

Iwluation Materials 

*;ithvir . . , ' 

: ' Total 



I'eo^le Attending' In-Servlce Training 
, A-jetmiea. , :"■ , • 
iTdmal Korkshd^s 
In-School Training sessions 
Ciireer Education Extension Classes 
■ -V:mh Eitperlence, Frogranis - ' - 

C^ceuj^atlonal Field Ttips . 



Total 



'i» Sit leudents Involved in Counseling 
tn41vWiual Student Counseling 

'-y i^&tip -Counseling ;- ' . . \ " ■ ■ 
. J^fti'ciai Guidance ActiV'itl^^ Career Ed Day 

Career Edutfation Center-Library 
Ce^jSfultaticiit and/or Assistance to Teachers- 

'^^i-'''^-'^^'-— ■■■ ■ ■ ■ ■ ' ■ ' ■ : .1. v.,.;, :,' : Total - 



Projects 
01 02 03 04 05 06 



07 Ave. 



2U 
89 
23 
39 
26 



36 231 
47 41 



36 
29 
4 



55 
23 
52 



61 153 66 

33 104 23 

50 42 

45 21 

18 0 



58 117 
25 52 



25 
30 
5 



18 
23 
4 



36 
30 

18 
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counselors in some projects did work with teachers ^ some projects 
did not make nmch use of counselors in their instructlotial pro-- 
graxa* Only one of the p^^^ did not repdrt cdndueting , 

■r"^ 6ny counseling activities for" either students or teachers* 

deteriQlne whether there were dif ferences among the seven 
" ' ' cdireer education ijrojects in terms of the type and amount 

; ^^^^ — 

the data presented in Table 4 were obtained via the teacher self -evaluation : 
form# D^tA ate sutnmarized by^^^ ind across ptoj^ects for each of the following t 

(1) total aind average nmnber Itisttuction^l- activitiesf (2) perci|nt df activities 
emt^loyinjg different methods of curriculum organization r (3) totfil and average amount^ 
df iusJttuctio^^ preparation and coiiiposite Instructional time, atid (4) perceritage of ' 
activities devo ted to clusters of career education content • Composite instruction 
tliiie . i^ the sum of preparation and instruction time • ■ 

A total of 10,026 career education instructional activities were 
reported by the teachers in the seven projects. Ori the average, 
each teacher conducted twenty-one (21) different instructional .. 
activities related to career education during the year. It ap- 

V pears that; on the average, the teachers in the three projects 
(03, 04, and 05) conducted more activities than teachers in the 

: ■ - other ptojectst ; ■ ■■ , ■ . 

2» Of the total number of actlvitiee conducted (10^026) , sixty-four 
periieht (64%) of them were integrated with the regular course con*^ 
. tent and $bout eighteen percent (18%) were taught either as sepa- ' 
rate units or classes, respectively* Wlvile some of th^ projects 
■■ differed \tn the -way— in which the activities -were placed in the cur- 

- - rlcnlumt more than fifty percent of the activities conducted in 

each project were integrated with the regular course content. * ' - ■ 

3 • Teachers reported to have spent a total of 17,606 hours conducting 
and preparing for career education instruction. About sixty-five, 
petcettt (65%) of the time was for actual classroom instruction and 
the remaining time (35%) was used for preparation. On the average, 
y each of the 498 teachers who participated in the process evaluation 
spent about 35 hours over a seven month period of time on carrier 
education ins true ti'on activlti<^ • This amounts to an, average of 
about five hours per month or about 1.25 hours per week. Based on 
'■A ftill 180 days of school (1440 hours) each , teacher spent a little 
„ .-more than two percent (2.43%) of the school year preparing for and/ 
or conducting career education activities, there was, however, 
considerable differences among projects in terms of the average 

V : amount of time teachers devoted to career education instruction. 

The averages range from a high of 46 hours a year (project OS) to 
V a- low of 18 hours a year (project 06). 
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th# results vere about the satne In terins of the average amount 
(Df to either career education instruction 

or preparation. Teachers in project 05 had the highest yearly _ 
. - Average and teacihers in project 06 had the lowest yesarly av6faie. 

4, This areas of content that received the greatest emphasis were ....^ 
(«) occupational Industries and (b) Self awa^^^ the content /' " 
areais which received the least emphasis were (a) workers and <b) 

career planning process . .Wille^^ _tjher# wer e some dlMekences in _ „ . _ . 

the relative etaphasis of certain content areasV the geitteral dis- 
tribution 'aaotig content areas Was fbdutth^^^^ the 
projects. It therefore seems saf^ to cohciude that while the 
«Bxact content for each instruc'tlonal activity may have differed 
greatly among tfe^chers, and that thev projects may have ei^phasized 
different Itistructional techniques, th^^ 

(objectives) was very similar for each of the projects. (j 

Obtfettive H i , .'I 

to detfermlne whether th^re were differences among t 
' career education projects in terms of the instructional 

inethods used by teachers to implement career education. 

f Information regarding the^ use of various instruction methods was obtaitied via 
teacher response to the self -evaluation form. Table 5 presents the data in terms 
ot frequettclea (N), percents and rank orders of ittstructional methods used for 
each project separately and for the seven projects collectively. 

A total of 10,026 activities werer conducted by the teachers in the seven pro- 
j'ecta during a seven month period. The instructional methods used most frequently 
were ranked as follows; (1) avdio visual, (2) presentation-discussion, (3) class 
projects, (4) wO'kers in class, (5) role playing, (6) field trips, and (7) coun- 
selittg and guida! ce. The least frequently used methods were: (13) inter-claas 
projects, (12) wctk observationi (11) use of information center, (10) simulated 
work experience/ (9) career gamefij and (8) work experience. 

A comparison of the projects in terms of the rank order of instructional 
methods used, shcfWS some obvious differences in the way in which each project - 
itspleaettted caret r education. The greatest diffetencea that were detected among 
projects Occured in the use of : (a) field trips, (b) work observation, (c) work 
experience, (d) career gatoes, (e) class projects, (f ) counseling and guidance, 
and (g) use of i formation center. It, therefore» seems safe to conclude that 
while projects made use of different combinations of methods to implement career 
education, they also used instructional techniques that were quite common to each 
other* • ' - 

Table 6 shew* the total and average amount of time devoted to each method of 
instruction for the seven projects separately and 'Collectively. Teachers spent a 
total of about 17,606 hours either preparing for or .teaching career education. On 
the average, each teacher spent about 35.4 hours of tiae on career education during 
the year with each activity taking on 'the average of 2.0 hours of composite instruc 
tion time. ' • 
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It: seems appar^ttt that teachers made use of a wide range of .instructional 
techniqiiea, however, a greater amount of tinse was devoted to the use of visual 
aids I presentation^discusj^ions and class projects than ^ome of the other instruc- 
tional methods. Audlo-viaual and presentation-discussion, on the average, 
requited the least amount of time per activity (1.1 hours and 1.3 hours respec- 
tively). Activities which, dn the average, seera'^to require the most time were; 
(a) simulated wotk eKperienee (3.3 hours), (b) field trips j(2.S hours) and (c) 
v^tk e>:perience! (2.7 hours). In general it seems that activities which make 
use 6f facilities outside of the classroom or try to simulate actual work ex- 
pediences require considerably more time than activities which typically can be 
taught in the regular classroom. ' - . 

Fro^ectn seemed to differ with respect to the average amount of time they 
devoted to the various instructional methods. Table 7 shows the "range' in the 
average amount of timet consumed by each method of instruction. 



Table 7 

RANGE AVERAGE MiOmiT OFJ TII^ (HOURS) CONSTOIED 
BY EACH Ot THIRTEEN INSTRUCTIONAL METHODS 



High 



Range 



• Low 



Field Trip ^ 
ferlters in Glass 
Work Observation 
!^0rk EKperience 
Audio Visual 
Eole Playing 
Career GamQQ 
Presentatldn-Blscussion 
Frajects In class 
Inter-Class Projects 
Staulated Work Experience 
Cdunseling and Guidance 
Ove of Ittforiiiation Center 



3.8 
2.8 



-2r5- 
3.3 
2.2 
3.1 
3.4 
3.0 
3.2 
5.1 
6.0 
3.8 
2.4 



2.0 
1.0 

.7 
1.1 

.9 
1.2 
'.9 

.8 
1.4 

.8 
1.6 

.9 

.8 



ITiis Information suggests that one of tt^e differences that may enist atEong 
pt^^lectu iQ the relative aiaouut of tim& whlab is devoted t& each ii«stl\?lty. This. 

mt suggest that the quality of instruction in the projects vere not equal* 
^ut only that fehfe dtstrtBution of tirae per Instructional method wa^ different. 
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The data contained |rt this report were based on monthly self -evaluations 
coiDpleted by- both teachetrs and directors for a seven -month period. Because the 
ft ittforaatiofi vaa collected at only One point In tilie, no attempt was raada to em- 
Q pltically determine the exact validity or reliability of the data. Howevat, an 
att^tapt was tiiade through a survey of teachets to obtain a gross estlioate of the 
0^ reliability and validity of the aata obt^ixted by the specially designed optical 
I J ^can form. 

w ■ ' . ' - 

There liiay be some doubt about the validity and ^reliability of the data 

3 provided by teachers^ The percent of errors teachers made in completing the 
self^evaluatlon forta each month ranged from a high of seventy-three percent 
(73%) for the first reporting period to a low of eleven percent (11%) in the 

3 last repbrting period. It seems likely that teachers had difficulty completing 
the form either^ because (a) the form otv directions were not clear or (b) teachers 
^ wete not accustomed to completing an optical scan evaluation fom. Based on a 
f^'-^h;- survey of teachers who participated in the evaluation^ it seemed apparent that 

most teachers waited until the end of the month to complete the form rather than 
com|>leting it on a daily basis as dltected# Cji5mpleting the form in retrospect at 
the end of the month may tend to produce a certain amount* of unreliability. On 
f\ the other hand, a majority of the teachers reported that ^ they felt (a) the dlrec*-* 
_^lohs on the font ware quite clear, (b) the form was quite comprehensive and. easy 
to follow, and (c) they accurately reported all of the instructional activities 
ft they conducted evi^n though most forms Were not completed until the end of the . 
laontht ^-^ _ - ^ 



^ Th6 6tatc of Minnesota utillsied its shate of federal funding to assist 

.eight different i?chool districts to itnplement career education* lEach of the 

Oiprojects proposed uniquely different ways for implementing career education. 
Because bo little was known about the most effective or efficient way(s) to 
Implement career education, the Minnesota RCU was contracted to develop and 
operate a <romprehenslve syatett of evaluation in order to obtain the tlecessary 
y enipxrlcal inforfiiatiott for making decisions about improving the quality and 
^^^5^tity of actijvities in each of the developmental projects* This report 
contains a desctiptiott of the formative evaluation (process evaluation) used 
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by tteacbers/and airectors to implement cateer education. Because o£ a change 
in |>toiecyV only 8 of the eight projects participated in the evaluation 
daring the 1972-73 school year. -The study vas primarily concerned with deter- 
jdirtln^ v?hethcr there veire differences among the projects in tetms of the amount i V 
type ahd distribution of effort in eateer education that was devoted to (a) support 
£tctivitieB% (b> indttuctional methods and (c) iiistructional content. 

Data were obtained from project directors, selected 6upport personnel and 
-from teachers for a seven month period using two specially designed self-eval- 
" uatlon forms. Directors and support personnel completed a self-evaluation form 
which described the type and amount of effort devoted to liUpport activities each 
cjonth* Teaehets described the type of instructional methods and amount of time 

they devoted to career-, education by completing a f orm d^^ig^^d 

optical scanning eqSaipment.. Teachers- were asKed to "describe" each activity 
related; to career education by /'darkening" the appropriate circles on the f otm^ 
Tlve foriE provided teachers the opportunity to describe twenty (20) separate 
"activities each month in terms of (a) methods of instructionr <b) curriculum 
orgainisation^ (t) success of the activity to interest, and motivate students^ 
(d) amount of preparation and ins truotion time devoted to each activity, (e) 
number of students served and (f) content emphasis. , 

teacltera and directors- began completing^ tha forms in October 1972. Each 
month directors received a Cuuiulative autraaary of the support .activitiea in their 
project. Teachfiira were provided with computer printouts of their career educa-^ 
: tlon Ittstructloaal activitiea five times during the year. . , ^ 

The formative evaluation design ealled for a continuous .aystem^of data 
" aiialvsls and feedback such that itciaesdiate modifications could bB made In each^ 
project on a monthly basis. A total of about 3500 self -evaluation forms were 
■ irocesscd for about 500*partlclpating teachers . There seems to Be^littlf 
Jaoubt that the optical scan form used by teachars-reprcaents an efficient 
«ay to obtain and analyse large quantities of data.. The ralatlve cost of 
collccfeinc the data from teachers using the optical scan form was about $1.58. . 
pet teacher in contrast to the eoat of collecting the sdm data>y more con- 
ventional means and theft having it kaypunched. The latter meth&d would have 
averaged about $19.00 per teacher. 

The cottclus ions coacerning the type and amount of Support activities 
provided ate as followa: 

1, Project dltectors reported to have engaged in a wide rartge of 
support activitiea to Include (a). project administration and 
supervision, (b) promotional activities (written and oral) , 

(C) curriculum development, (d) in-service training and (e) . 
guidance and eounsellng services to students and, staff. ^ 

2. Project dlrectot's devoted, on the average, about seveh teen. . 
-i^ percent (17%) of their work load to the career education pro- 
ject with most of the time spenfr oft. project administration and 
aupervlslon. * 



3* ^Projects did differ in tertns of the amount of emphasis devoted 

■ -'id?.' 
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to'(a) prdinotiorial activities, (b) in-setvice training, (a) eurrlculum develop-^ 
ment and (d) counseling services. - 

Based on the Information provided by teachers using the specially designed 
0elf-evaluatlon, forms, the toxiowing conclusions seem warranted:^ " 

£ach* teacher t?ho participated in the evaluation process conducted, 
on the average, twenty -one (21) activities related to career 
edtication during a seven month period which consumed (on the 
average) about tltlrty^five (35) hours of preparation and instruc- 
tion, time. This means that each teacher spent about five hours 
a month or about oi&e and one-quarter -(1.25) hours per week on 
^ Ins true tlpn43L activities related to career education. While 
projects t^^nded to differ in terms of the average number Of 
activities conducted and *the average number of hours teachers 
devoted to career education, these dif ferenceg were not large. 

y ~~ ' ^ ■ ^ ~ \ " ^f" ■ ■ ; 

2\ A majority of the activities conductecl by teachefs were 
integrated with the regular course contetitj ^pportlonally 
fewer activitd[,es were taught as separate cla^^es or units. ;^ 
Projects^ did riot differ substantially in terms of -the way 
career education activities were implemented into the curriculum. 

* - 

■ - _^ ^ %, 
3. Teachers tended to place emphasia on different content areas 
(objectives). A majority of the instructional emphasis was 
^ placed on (a) self awareness concepts, and (b) Industries. 
Proportionately less emphasis, was placed on (a) career planning 
" processes, (b) work role requiremetj^ts and worker § and ,;Cc) 
occupatlotial levels. Although there ware some differences 
among project a in terms of content emphasis, the general 
distribution o£ effort across content areas was quite similar. 

4» Teachers conducTted a total of 10,026 career education activities 
which consumed about 17,606 hours of instiructlon and prep^atlon 
^ time. These activities were distributed somewhat diSpropofv^lon-- 

ately among .thirteen types of instructional methods* The moXt 
. frequently used methods were: (a) audlo-^vlsual presentations >X 
(b) presentation and discussion, (c> class projects, and (d) 
workers in clsss* The least frequently used methods were; 
(a) inter-class projects, (b) work obser\ration, (c) use of 
information center, (d) career games, and (e) work experience. 
The general conclusion suggests that teachers preferred instruc- 
tional methods which could be conducted wl thin.. the classroom. 



3 




5. Projects did differ In terms of the relative use of 

various instructional methods . Majot differences occured 
In the use of about seven instructional methodsi (1) field 
trlpo, (2) work observation, (3) work experience, (4) career . 

3' games, (5) class projects, (6). counseling and (7) use of infor- 

matlon center. This conclusion supports the contention that 
A projects did, In fact, differ ^itl^ respect to the manner in , 

which. career education was implemented. 
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6 " certain instructional oetliods tended to consume more inatruc- 
tional time than other methods. On the averagew^ methods 
- which consumed the most time were those vhich dealt with or 
attempted to simulate work experiences outside of the class- 

^ — tooffi"CeTg;Ttieiartri:psv-8ifflulated^^ 



room LC»g*v I^-teJUU UtJUpO, cr^iMV*^**w>.^ " — ,r - ^ 

experience) . The methods which consumed the least amount 
of* title were those which could, most easily be taught in the 
classroom. Ce.g. audio-visual presentations, presentation- 

----- - discussions , career games* etc.) ■ ,:— ■ ■-• - ..,.„..-.,. 

Prdiects differed considerably in t^rms df the average amount 
of time devoted to each of the instructional methods. It 
appears that projects may have had different strategies for 
implejnenting careiar education. Some teachers appeared to 
ia?e Sticted fewer activm^^ 

While others appeared to have conducted more activities but - 
^ spent less time on each activity. . 

RecommendatCong. . 

'•rhc findings suggest that two types of recommendatiorts be made in the project 
m subsequent years. First, it seems apparent that the ins trumenbs needed tp de- 
ijcribe the "processes" used to Implement career education l)e modif;>red and improved. 
Second, that director's and teachers be enc(?uraged to spexiasa^e^er proportion of 
their time towards implensenting career education. 

Sei f-Evaluetion Instrumant t Of the two self-evaluatio^tos^s^ents^used, only th6 
^itical acin form for teadiers appears to nefed improvement. Suggested areas of 
itxi>rovement are as follows; 

1. Provide space to code the number of forms submitted each month 
and eliminate the codr dealing with "number of students . 

2. Revise and Clarify^ dir.ectiona with cinphasio on completing the 
form on A daily basis. 

3/ Eliminate separate grade- designations and create clusters of 
grades Ce.g* 4-6, 7*9, 10-12). 

4* Modify existing and add different types of instructional methods 
: to the form., ■ ^ , - « * ' ■•; 

Kuaber each of the major categories^ipn the fork to insure that ; 
teacher » place a "mark" in each category. 

6. Add a row of optical scan circles for taachera to ittdl^i^ 
(a) no preparatioft time was needed and (b) that more than^ 
100 students were involved in an instructional ac^iivity. 




7. Shade alternate cqIuubis on the form so it will be easier for 
teachers to follow the correct coluEin down the form. 

Pro&raiB Ifeiplementation ; It is generally accepted that tfie amount students learn 
Itt a sub ject is direct ly related to the amount^' time a teacher- 4evotes--t©-tha£- 



4,11 4* ^yMiM j'^v ^ w <*»w «»^ w^^i>^v^ ^wm^ — — '^ 

subject* If thialissufflption is correct, the more emphasis that is placed on ca- 
reer education, the greater the impact is likely to bei on students. 

Project directors devoted about twenty-five percent (25*0 of their time ad- 
ministering and supervising the- career education projects and: teachers spent 
slightly less than three percent of their total school year teachli^g concepts 
related to career education, ^-ihile the appropriate amount of time that should 
fee devoted to career education has not been specified, it would seera that teachers 
are likely to have to devote more time to it if the Ihtent is to make an impact 
Oft students. It therefore seems plausible that both teachers and directors in 
the exemplary projects reassess the distribution of their responsibilities for 
catcer education aiid establish some guidelines for the asabunt of time that should 
be devoted to career education. 
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- , APPENDIX A 

Biographical Data Concerning the Career Education 
. Teachers of Exemplary Projects 
r!! it^gk or write in appropriate answers * 
. laeatif ication Coiea ; ^ , , 




1 I / Project School Teacher Code ^ '~ 

Nutflber of years of teaching experience (including this year) : ^ :g 

2i Hutnber of years o£ full-timfe non-school work experience .in business and ' 
indtistry (including military) t ^ , ^ * ' ^ 

3. Amount of in-service c^treer education training: - ; '■; 

/L* Nufisber of organised field trips to business and industry for fl. 

career orientation: ■ ' ■ 'Id 

BV Kutaber of credits from cQllege classes in career education: 

C: Number of hours spent. in* formal career educati^^ . . rt' 

D* mimber of hours spent in career education staff meetings: , . \ , - ^ ^ 

4* Were you iavoived in organized curriculum development activities for the 

cateet educatlbn project? Yes ^ ^ No ^ * If yes, how many hours did 

Vdu spend in this activity? 

5V Kliich of the following locations best describes your residence before 
teaching? Rural Small town ■ Urban . ^ Suburban ... \^ 

6., What was your primary curriculum emphasis in high school? 
. -General Preparation . College Preparation ^ ^ Vocational Preparation 

Date of high school graduation: . .:. 



7f What is your current degree status ^nd major field? 



Bachelors Major 

Bachelors plus Hajor 

Masters Major 

Masters plus Major 

Doctorate ^ _ Major 



dv How many years have you been directly involved in the career education 
project (including this year)? 

9^ Hov many years have you included the planned study of career educatioft 
iu your classes? ^ 



ERIC 



152 




O 

.< 

a-' 

O 

2S 



5 

O 



o 

Is 

p C 



CO ^ 



<2 



e 

o 

ax 



O; <U 

- c ■ ; 

J3 ^ ^<=^ 

OJ « 
> w 
id ^ (u 

S >^ 

)^ Ci S - 

> .(d 
o « S 



2 

0) 

>- 

o 

*o 

cx 
o 



o) 2 

c ^ 

o o 

P 

£ > 

c. ."^ 

o ^ 

O <D 
O 

>v 



tJ 

E 

o 
o 

t> 

w 
>» 

o 



o ns; S 
S £ g: o 



a t> 
P 3 



E5 



O tJ 



0) 

(1) Q. 



o o >, — 

:3 o t; 03 

o a c J;: 
>^ w 

^^^^ 



'CO 



C O %Q> 
Q> Of 0> 

-S o ^ 



a 
c 

o 

CL 



c 
S g 



or 
o 
o 

a> 

ox 

w 
CO 

o 



C 



o 
c« 

15 

'c 
o 

1 

<♦-» 
0) 

c 

o 
to 

a> 
Ja 

*\Z 

o 
en 



O (0 

(0 g 

c E 

^ "J? 



01 



T>0 



c 
o 
E 

(0 
TJ 

u 

o 
xo 



e i 

P 

£ o 

e H 

(0 « 

ail 

C CO 

O Q. 

^ (0 

c o 

2 S 

13 c 



o Z 




■If- 



-a 
M 

DC 

iti 

UJ 

< 

o 

o 

o 

< 
> 



Ui 
0 

"cc" 

Ui 
X 

o 

UJf 



0) 
G 
O 

0) 

•V- 

O) 
C 

(0 

a 



CC *^ Qj 



:::: 
s « 



?^ ^ 

o 



3 <^hSS 
w . »« to 



a 

e 

0) 



to 5 

m E 
^ 2 



6 2 



X) 



O 



S « 

^ c p 

^ ^ >r ^ = 

to g CO CO 



o 



o 
u. 



o fl) CD a> 
D UJ 5 



CO 

E 

^ e 

Q lit 



0-.S 

CD 

V. o O ja> 

S £ w 55 



CO 



O ^ ID to O 

CO 

O X5 

£ «? 



(0 . y 
x: 
3= 



xt 
o 

«* 

E 

C 



1 e5 



ct o 
CO :b 3 



O 

U 

x: 



^ 13 



is c 



a> (0 
o 

C: Q> 
X> 
G 

o 

O) <o 
4 -o 7s 

B^3b 



fX 



0) 



S 

*r;. (0 
-CO 

S tJ 
CO 

E « 

5? x: 

XJ 

-d >^ 

g CO 

(D O 

^' O 

c: 3 
Q> Jt:: 
a. to 
O £ 

CO 



^E 0).. 
St 

CO w 

Xi 5 

©^ 
"5 CO 

a^E 
E o 
o jt 

2> (0 

UJ 



& 

CO 
V) 

to 
o 
o 
<u 

G Xi 

ffl g 

to ^ 
vi £ 
§5 
o <^ 



o 

■3 - 
o 

o 
o 



c 



CO 



E i? 



Q) 
Xl 

E 
x: 



O 

3 

Q. 

2 
cx 
a 

CO 



CO 
o 

c 



a 

CO 



CO 

g- CP 

o o 
o ^ 

to CO 

* - -a 



0) 

(0 XI 

E^ 

o £ 
— o 

C 0 



o* '5 



o o o 
jz o x: 

o c 



> B x> 
a: S» S 

d. 

CD 



(0 



o 

« 
C 

x: 

£ 
o 

to 
Q) 
TJ 



E ^ 



^ XT o 



5 g ^ 

E •§ « 

O ,0) o 

x: H 3 

« 

ft* o cu 



O 



CO 

a 

(D 

CC 
Q) 



>> {rt 
X3 o ^ 

n I « 

> 13 E 
.to ^ 

^ y 

4^ OC 5 



X 

.cu 



0) 
to 

E to 3 
P Q> w 

is c 

iO c *^ 

ill 

x: ^ CO 



Q 

O 

o 

o 

p 



C!?ft)C->> ® 0 ® ® 



^ Q 0 ® a © ® a 



o 



3 ^ 



3 3 c> i^- o ffl s tJ 3 CL J5 

4 < w O Q v? uI S < S ' 

QQOOOCS^OOaOOQ 



f\J^^ KJ KJ\J KJ U U U U 

el 



Ui 



ERIC 



o -J 



C 

D 



153 




iNSTftUCTIONAL ACtlVmeS IN CA«EEB EDUCATION 
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*\ APPENDIX C 

Cumulative Surnmary of Support Activities in Career Education for the tiioWth of 

(Directors Form) 



Name of Director 



{ 



Project Name 
Date Reported. 



Project Code Number — ■ \ — - ~ y — 

Directions; the purpose of this log sheet Ls to obtain information from the director about his activities and the activities of 
support staff which contribute directly to the success of the career education project. At the end of each week the.dirGctor is 
encouraged to complete this form by (a) looking in retrospect at his activities and (b) obtaining relevant Information about 
theactivities pf other support personnel. * ^ . , ^ 



c ■■ 
o 

*5 

C ^ 4J 
at 4-« 

g 'E g 



General Project Administration*Supervisfon 

Securing Information and/or Consultation 

Attend Noii School Career Education Meetings or Conferences 

Project Evaluation ■■■ . - . ^ 

Other (^pemfy) „ 



Number of Hours 



Number of 
Presentations 



Total Amount 
of Time (Hrs) 



No. of People 
Attending 



X 9 H 
0*0 « 

< w 

^ a>. 

C ,« 

S 3 av:2 
E H 

S" ■ 

d; o. 2 



Community and/or Social Groups 
Occupational or Advisory Groups 
fifsal Rnhoot and fichool Board Personnel 



3 



Non-tocal Precentations 

Presentations at State or Nattenal Conventions 

Other (Specify) .- , - ■^^.^^-^...^^-^ — 



Number 
Produced 



Number 

Disseminated 



Developmental 
Time (Mrs) 



Nev^s Letters / 
Projeet Reports 
Visual Displays 
Booklets or Pamphlets 
Mass Media Relea^ies 
.Other (Specify y.,:, 



cr 



ill «^ 



Printed tnstruGtional Matermls-Aids 
Audio Visual Materials 
Resource Guide or Study 
Books-References 
Evaluation Materials 
Other (j^pfirtfyi 



No. of Different Material 
Purchaced Developed 



Formal Workshops 
g In^Schodl Training Sessions 
% Career Education fiKtension Classes 



No* ofl'eople 
Attending 



Total Hours 
Per Week 



Man Hours of De- 

v elopmc^ntal Time 



Total Man 

Hour^Afeok 



to ^ 3 Work EKperiehce Programs 
£ IS Odeupational Field Trips 
Othdf (Specify) 



OS-' 



^ Individual Student Counseling 



No. of Students 
Participating 



No. of teachers 
Participatihq 



*! ^ c Group Counseling 



g % § Sm'id Guidanee Activities (e.g. Career Education Days) 
i ^ Career fiducatiort Cgnter'Ubrary 



Consultation mdlot AsSlstariCe to Teachers 





Form Completion Time: 
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APPENDIX E 



» EFFECTIVENESS AND EFFICIENCY .OF DATA 

: AND PROCESS EVALUATION SYSTEM 

Scoring Setlf-Evaluktlon Forms - ^ 

The self ^evaluation booklets were dlstrnjuted to teachers by the project 
directors ,on September 15, 1972* Since pr<jject directors or their designate 
would provide the in-service training to teachers, each director attended a 
traitilng session which described the procedures for coispleting the form* 
Teachers began completing the forms during the month of dctobet* In some 
instances forms were not completed until November because'of delayed in- 
service training sessions. 




te number of teactrers~t?Vo~r§ubi5ifted forms for eachrof~tKe~^" 
seven months data were collected and the'numbet of forms that had to be corrected 
and re-scored. It should be no ted » howevet, that each fotm rejected by the 
computer had already been edited by botli the project director arid a member of 
the BCU 8ta££. . I . ' ' 

- . * * Table 8 , 



NUr-ffiER OF TEACHER SELF-EVALUAtlON FORl-fS SCORED AI^D RE-SCORED 
DUftlMG THE 1972-75 ACADEMIG SCHOOL YEAR * 

(TOTALS FOR SEVEil CAREER EDUCATION PROJECTS) 



Month 


Initial 
Scored 


Number 
Re-Scored 


Error Rate 


Octobet 


467 


339 


73% 




^ 543 


116 


21% 










December ^ 


• I 457 


62 


14% 


January 


440 


66 


15% 


February ^ 




65 i 


14% 


Match 




' 51 


11% 


April 


365 


^ 45 


12% 


total 


3»224 ^ 

-i 


74A 


23% 



157 



Table 8 indicates that ^ tot^ 6£ 3*224 forias were scored for thev^98 
c It tlcipa ting teachers* D th6 seven. .iftpnth periodic 744 forms had to be 

rUacorid at least once* This indicates that there was, on the average,, 
afeout a tweiity--three percent error rate in scoring the forms* The highest 
ierror rate was seventy-three percent (73%) for the nionth ol^ October and grad-: 
uillv iinproved to a low of eleven percent (llX) in March. It Should be. noted, 
hmmett that each form was subjected to a very critical edit by the computer, 
that is, if'^dnly one circle or section of the form was not filled in correctly, 
the entire form was rejected and had to be, xe-scored* Consequently, while thfe 
petcetitage of forms re-$cored was rathe^^yj^h, tlte actual number of significant 
ertors were probably much lover* RecatdlTofi the number of errors made' per form 
iw?ete not kept* . ^_ ' 

The findings suggest tJiat increased use of and familiarity With the instru- - 
t-ant tends to substantially reduce the number of .errors made by teacher j^j^ Add- 
itidnai taodlfications in the form and more in-service tralnitig may even further 
reduce the number of errors and thus Increase, the effectiyeneais of the instrui&ent 



the effiolenoy of tjbiisldata coliection process can be judged in terms of the 
eost per teacher as compared with other methods of data colleetion. The cost of 
printing the instrument wa^ Lbout $1.16 per* teacher, the average cost for scaring 
(and re-scoriilg) the foriijs d^a $.42 per teacher (over the seven month period 
$.06 per form). Thus the tjbtal cost for collecting seven feonths oi data from 
each ;^teacher was approziti^ely $1p$8. 

^ .■■ ■ ' ' , ■ ' ^» , ^ ■ 

To collect and Keypunch the same data , using a more standard data collection 
procedure would have east about $11,000. The average cost per teacher would have 
been $19.30 for the seven ttionth period. That is, it would have taken twenty-six 
eosputer cards per month per teacher to record the sarue data collected via the 
optical scan form* A total of 90,636 cards would have been required for the 498 
reachera during the seven month period* the cost of keypunching alone would have 
bi^en nearly $10,37S. Thus, by using the optical scan instrument, there is a net 
savings of $17.72 per teaahe/with a total savings of nearly SS,825.00. conse- 
quently, although the instrument had shortcomings in terms bf its effectiveness 
C^v^euracy) > it appeared to represent a very efficient way to collect itnd score 
large quantities of data# ( 

in order to further assess the effeetiveness of the evaruation system a 
^iu^^ationnaire was distributed to each of the 498 pairticipating teachers in May 
of 1973/ the questionnaire was designed to determine the relative reliability 
and validity of the data collected and assess the general ^u tility of the A t^al-** 
uatidn system. The questionnaire consisted of thirteen (13) items, the t:di*st 
two referred to when the self -evaluation formd were filled out (daily, weekly,, 
-^t monthly) by each teacher and how acdurately the teachers were able to describe 
tM iitstructioital activities In which they engaged. Items numbered 3 through 10 
vere ooncerne# with the claritj^ of instrucciona ancl ease in completing the self-^ 
Vvalitjtian fofeis* Items 11 and 12 were related m the general validiity of the 
inarrument; attd the final question provided the opportunity for teachers to give 
titcdr personal bp inions-about"-the^ 
;b4^k oyatem* ■ ' ■ , • 
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The population of teachers who received the questionnaire included all 
teachers who had beeh involved in the exemplary career education projects during 
the 1972-73 school year* The number of teachers patticipating within each dis- 
trict at each school level is shown in Table 9, A total of questionnaires 
, were stint to Individual teachets; 283 were returned to the ECU for, analysis . - 
'Thig represents a return rate of fifty^seven percent(S72) . 

Table 9 

SUM^^t OF RETURNS m TEACHER EVAl^mtlOH QUfiSTIOmtRE 



PROJECT 



Elementary ' Junior High Senior High 



'Totals 



Number Kumber Nuaber Number Number Number Uumber Nutaber Percent 
Sent Returned Sent ' Returned Sent Returned Sent Returned. ReturnQd 



02 



15 



23 



39*8 



03 



113 101 



113 101 



89.0 



OA 



21 



1-9 



23 



19 



M 3g 



86.3 



05 



122 



75 



67 



11 



189 



86 



45.5 



06 



57 



0 



57 



00.0 



S 



07 



39 



36- 



39^ 



36 



92.3 



TOTALS 



3^5 



.240 



110 



38 



13 



498 



283 



56.8 



To analyze the questionnaires which were retur ned, a fr e quency di stribution 
was tabulated for each response to the first^twelve (12) Ilcks. A dii-square, 
goodness-of-fit test of Significance was then run on each iteta independently. 
It was hvpothesiscd that the distribution o*f observed responses would not differ 
significantlv from that of a rectangular frequency distiributiein. A core? ilation 
o£ i£he data collected on each of these items and the computation of the chi- 
sguare values is pres44t.ed In Table 10 . - , 

-Ttie^M^quar^g-^ati^gB-^eaUtt lilted for the gdodness^of^flt tests^Jllusr,,_, 



ttate that the distribution of the response f requencdas 'f or all the items 
differed significantly fre* the hypothesized rectangular distribution. In 
"Paeh case, the probability of achieving the specific chi-square value or 



table 10 



SUMMARY OF RESPOHSES TO QUESTIONNAIRE BY PERCENTAGES 



Response 



In geriural^ when, did you fill Itt the , 
teacher self '-evaluatidn f orta for 
carecjr education related aGtivltieg? 



liDw acpurataly werei you able to 
"de&crlbe" t^e career education 
acttvllJies 



VDU taught? 



Response 



tten 



4.1 



4.4 



Ha%^ cleats are the dlreetlons f or pom~ 



piecing the form? 



7.6 



9.0 



58.1 



9*0 



31.9 



3kO 



4.8 



24.0 37.0 2Sv4.-8-.7i 



74.8 



0.7 



503.51 



329.29 



3 I X- 



p-value 



.001 



♦ 001 



p-vaXue 



, Hqw compj^ete d.re the dhz^ct±6m-on [ ^ 
the f orm?%.. 1 



Is the fotmt of the Insttumant laid C 
5 out itt a manner which is easy to ^13*6 
^ follow? ■ ^ . ' ^ ■ 



36.6 



33.0 



10.9! 108.63 

1 



18.3 



29.7 



— r — ^ 

30,4. 8.1I 53.05 



.001 



.001 



? 4.8 



f ts the material included in the 
^ instrutaent cooprehensive? 

Is the instruaenfc flexible enough to » 
7 allow ttai'king' ffloat career education 5_.l 

,._„-0gi.iy4tte,s'l ,. .. ,-— 



16.7 



14.1 



34.aU9.3il4.4 



27.61 33.2j 14.5 



78.00 



.001 



92.21 



.001 



gVUdv would you -rate the amount of time * o 
' tequlred to use the instruinent? I .* 



11.9' 33.1? 27.9' 24.2 81.53 

.1 . . .■" 



.001 



How valuable" is the printed feedback 
to you as a teacher? 



26. 4; 35. 9' 27.8 



..y Uld you have difficulty {carking the 
•'Identlfieation Code'* section? 



! » i 
1.4; 3.9.12.0 



Jteap-Oatsja ^^^^ 



8.1 



1.8|112.96 



.001 



14.15 68.6 433.06 



.001 



p=value^ 



H.ivtj yau mde changes in your ;career 
U- eJucaeio.n activities as a' result of 

■^*.-^.Jd'£...--'^'y*!dHaek'-you, received?. 



23.6,76.4: 



t-. -'■'R.-H'jld the fotds be modified befote ' 



tim^ are. used again? 



71,6 28. 4 



; 75.46 



48.92 



.001 



.001 



ERIC 



I'GD 



j^g^^j^ vad less -than •^01 (p<»001)i The conclusions and/ or recoimiiendations 
r^aultirig from the analysis of each Iteia are noted below. 

Item #1 : The great laajorlty of teachers waited until the end of each 
tsbnth to cOD5)lete the form. This may have been one important reason why 
Gjany teachers found it difficult to classify their instructional activities 
vhy some felt it was time-consuming to opmplete the form* It may have 
als6 resulted in an lnaccux*ate reporting of activities. 

Item fi2j Although most teacheijs felt the instrument allowed them to 
describe their activltlea very aecurately or fairly accurately, a number 
felt the Instrument di^-n^t enable an adequate descrip'tion of their efforts, 
this inay have befen due to a need for greater clarification of the various 
^ectio'as of the ixym or th^ need for teachers to record their activities ©n 
(i. ji:dre frequent, b^ia. / 

tteias'.i!?3 ^_and \M: The _dlrections f or completing the form were » for the 

^59irporc~c1:^^^ . ft we ve r » r e $p ^ ^ d ir ec t i ons 

my have to be chaliged fj^r greatex* clarity. A carefully planned in-servlee 
training program might eliminate some of the problems encountered with the 
directions* 

Itenis ifS and 0t Apparently the physical format of the instrument did 
not create a great deal of misunderstanding and there was sufficient flexi- 
bility for markittg most activities. On the other hand* the difficulties 
perceived by dome individuals may be alleviated by modiflcationo in the 
form. 

lteBj|6t The response distribution for this item indicates a feeling of 
general adequacy with respect to the instrument's eon^rehensiveness* 

Item gSt Even though many te^cherS' tended to ;feal the amount o£ tlmci 
required to complete the form was minimal, a greater proportion may have 
Celt this way if they had filled out the form on a daily basis rather than 
T20r^thly. . . 

Item #9 : The perceived utility of" the computer prlntoujtr (feedback 
InfOTrntion) sent to each teacher was very low. This indicates a need to 
either discontinue this part of the formative evaluation or include a discussion 
of thd puriJose and the interpretation of the form in an in-serylce training 

Item, 10: Most teachers found it relatively easy to complete the infor- 
t^itlon ri^quired for the^^Identlflcatlon Code** section of the form.* Those who 
raund it difficult may have been confused in classifying their curriculum 
^teaCa), This section may have to be changed on the revised form. 

j tem^jll s The lack o£ change in instructlDnal actividies resulting from 
the feedback ' received b/ each teacher via the computer printout may have been 

function of the need ta clarify ^the purpose of this information. However, 
It my be that no change should hav6 been reported* 
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j ttom #12. ; In &enaral> the responses to this Item indicata a need for a 
detailed in-^aervice training program emphasizing the purposi^ of tha self- 
evaiu^Ltiott instrument and the computari^ed feedback* Attention must also be, 
given to increasing the clarity 5f the directions for cotnplating the form and 
operationally deflnitig tha career education tarminology used* 

Efeh teacher made otie or'^mora subjective statainents about the form or 
the <^oi$iuter printouts they received* Ihe^e comments, in general, are 
sumMrised by the following seven statementat 

1^. The time reciuired to complete the form was not worth the feed- 
back reeeived/ 

- - - ^ * 

„ it The inBtrumant was vague in terms of 

a) direetiohs for eompleting the form, and 

b) the instructional activities to be recorded* 

3* The responses required tcere sometimes too general to be of value. 

A* The responaea required were sometimes to© specific to be of 
value. ^ 

5.. The -.purpose of the coraputar printout was unclear. 

6. It was difficult to classify" instructional activities. * 

7« The asibigulty of the various section.^ may result "in incon-*. 
$l£jtent teaehar responai^s* 

It ^eeraa.safe to conclude -that- there was Bbm Question aa to the effecti 
ness of the formative (pracess) evaluation By^tem aa far as teachers were con 
cerned* /Some of the major problems pet^tainiag to ita ef fecti\*enesa are as 
folldws: " * . 

^ Teachers did not eotiplete the torn en a d^ily basis, but rather 
conpleted thata at the end of the month. Consequently, the validity 
and reliability of their responses' can be questioned* 

<* 

2. Even though forne were eontploted af the end of the month, teaeht^r^ 
believed that the data were quite accurate, 

3-* /.Direations for completing the form can and should be Improved. 

4.. ■• Modifieations in the -coding information blocks and format of the • 
. data collection- part of the form can and should be improved. 

S'.- Cotfuter printouts were o^f questionable v^ilue to teac!iars t*lthou;h 
in-^^rvice training ttay radtite proMer.# , ' 
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Teachers' Assessment o£ the System for Obtaining Feedback 
About Theit Career Eduaation Activities * 



rdentificittlon Codes: 



Check each categpry at the rating level you choose 

1. fiow clear are the directions for completing the form? | 1 [ 2 j 3 | A | 5 1 

Unclear Very 

Clear 



2* How cbaplete are the directions on the form? 



3, Is the foricat of the instriiTCnt layad out In a 
manner which is easv to follow? 



cdmprehensiva? 

5* Is the Instrument flexible enough to allow 
tnarking most career education activities? 

How would you rate the amount of time required 
I to u^ the Instrument? 



7# Bow valuable is the printed feedback to you 
'as a teacher? 



I 1 1 2 I 3 I ^ I 5 I 

Incomplete Complete 

I 1 I 2 t 3 1 4 I 5 ( 
Confusing Easy to 

Follow 



Inadequate 



Adequate 



6.^ Did you have difficulty marking the 
"Identification Code'* section? 



1 1 1 2 1 3 I V ^ 5 I 

Inf lC3clbla Fle>^ibla 

I 1 I 2 I 3 I 4 I 5 t 

Too Much Not Too Mueh 

time Required Time Required 

UJt I 3 I 4 I .5, J 
Little . Very 
Value Valuable 

I 1 1 2 I 3 I 4 1.5 I 
Much Little 
Difficulty Difficulty 



n 

-u 

■I 



9* Have* you made changes in your career education aatlvities as a result of the 
feedback you received? Yes No 

10* Vhat improvements in the instrument or the computer printout would you suggest? 
(List them) 



PART II 

ASSESSING THE IMPACT^ CAREER EDUCATION 
OK STUDEOT ACHIE?12ffiKT 
INTRODUCTION 



If 



Mo0t of the national and state efforts toward Impletai^nting career education, 
have feeeti devoted to the in-service training of teachers and the d^velop©en£ of 
eurriculusn and instructional materlale. Relatively little effort has been ex- 
pended towards developing valid and reliable aritarion Inatruments to assess the 
liBjp^ct that liastructional prograBis have had op students • This is the second part 
of tha evaluation report which deals primrily with the relative impact career 
education projects in Minnesota have had on the eosmiti^e achievements of 8tu« 
dents in grades 1-9. , . ^ 

^ ^ ^ ^- _ \ . . 



Purposes and; ObjectiTOa - S ^ 

the purposes of this s^tudy were twofold: (1) to determine whether the J^- 
otruc^ants developed were reliable and sensitive to differencea-between and^^t^bng 
VGrioiia criterion group^^ and (2) to assess the relative impact the seven (7X;i|a- 
r^er educatii^n projects had on their studentet In order to detetidna wl)efchet| 
theise purposes were attained, the fallowing specific objectives for the atud}^f|^ 
were jjosedf " . |t 



Objective &1: 



Objective 52: 



Objective p3t 



to deter^ne whether thfe career education 
testo- were reliable and capable of dtmttm^ 
Inatlng asiang students in e^perisitsntal and 
control groupa at different grade (taaturity) 
levels in ter^s of m^an scores on the 1--3, 
4-6, and 7-9. career education teats respectively- 

To determine whether there were differences 
between cKpertmental and control gtmtm in 
terms of the laean scores of students on the 
1-3, 4-6, and 7-9 career education teats 
respectively • 

To determine whather there were differences 
among the seven (7) exemplary projects in 
tcnas of the mean scores of students on the 
1-3, 4^6, and 7-9 career education tests 
respectively* 



PROCEDURES 



-iM Sljjmpntation 

A final ^form of three criterion inatrunients was developed t© measure the 
eaetilcive achlevenient of students in grades 1-3, 4-6 and 7-9 respectively. A 

1.5 
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. 'f -^f^<.^^^^3 corvduc/ed in the fall of 1972 and as a result appropriate 
vnot H^^°l^^^^^'^^^on vere selected and/or revised for inclusion in 
icetss ^•^^|'^'^''*\f^f.f i^s^^ (Smith, et al, 1973) Only a brief description 

Se^df the e^^aluation (1972.^73) was coricetned, only fexth developing ^ . 
3h^.ai>t P^jse^Pt^^,^ achievements of students; subsequent phases will 

^'T '^^T^^^^^^^ Mstruments^e.sure a studetvt ' s at, itnde_^toward 
vpha^^ll the de/^l^pme^^ Beeau^^st of the exfemplary^areer education 

^^'vA^'ts i^m^ with eSment^ry and iuniar hiS^school stuaents. 

iSSloti for. the .enior high school ^^^.^^^^^^ 

- - ;careet Mucation developed hy the Minnesota' JCU suggests; 

r-it Se fiSt S^ee stages af career development are : m occupational^a^are- 

^ The rationale and modBl also suggests that^there are four major "»P°-^"J^ 
: xtie ^^f-^"- _ , t-^„„^ut a-^ a part of career education: (1) career 

: m^mt *«,J«!»i'^jg^^,-*0^ S«er decision yroce... and C4J work 

personality, (2) career .^.^^ii,.. ^^„. thea are described In 

adJusMant,^ These components and the , °°f ^g^f Luh et al, 1973). 

, «Je detail in other sources ft.oss "^l^^^^'^-^.J ^hf a^^er environment. 
: foL:n nt S re ope^JionaU. .e^ned ter. . 

oi the followlng^content area, (scales f -^.g^^ ^ rnJedsireintorcers. 
lndj»!«i..., » y) e«ploy«nt trends. 

:V5l!^°2»»s5:««Sai4'ie:a::d1o »easn?e student >.no»led.e .hout selected 

aspects of each sub-category. 

it^3 Tesfc^ Th^ first instrument developed was designed to measute student "aware 
^^ M^^ntf^e^l± of ^ot^. It was a 29 item te.t which w^s _read to students 
bv tlie tS^^^^ 

. .by the ^"^^t workers. Students, were directed to put an 

. - tnate. among, pictures of occupationax wo-r^ei-t.. ^> , .,w^». ,to-rp o^^nP-r- 

•^X" under :y picture which be. t answered the question. ^ ^^^^^ ^^^"^ Jf^^^^g^"^ 

^ ata to mea^uri knowledge abo^ 
: (V) OccupatiOtt^^^ i'^) ability^requirements, (d) n^eds and/ot 30b 5atis 

Mmtxiklom-^ )£ttid <6>.. working, ■eonditiorts^.or eharacteristic$.;, , . 



Te&t : The second 1^ to measure the cognitive knowledges 

of students in .grades 4-'6/ It was a 52 item, self-administered test in which . 
students made their responses on a separate aiiswer sheet cfesigned to be scored 
by optical scanning equipment. The tesjt Consisted of 32 matching items and 20 
multiple choice items. The contertt aireas measured by the test included 
(a) Ittdiis tries, (b) decupational levels, {cj ability requirements, (d) needs , 
and/or job satisfactions ^ (e) working conditions, and (f) career d^ecision making 
processes . ' , 

7^9 Test : , The third ins trutnent was designed to measure the cGgnitlve knowledges 
df students in grades 7r-9* It was a* 56 item, self— administered, mtiltiple choice 
test , in which students made their responses on 'a separate ..answer '^heet designed 
to be sicored*by optical scanning *equipment* The content domains «measured by the 
test included:, (a) industries , (b) occupatipnal levels, (c) abiiity tequlr^menta 
(d^ needs and/or job satisfactions, (e) working conditions, (f) career decision 
making proce^ and (g) employment trends k 

Each of the testa Was considered to be a "povet'' test rather than a *^speed'^ 
test , but could be administered in about 30-45 mixautes. ; * 



: Population 

Two sub^Q^ulations of students were Identified fpr this study. .One popula- 
tion was defix^ed as "experitaental'' and the other was defined as "control*'. >The 
e:<perimental population was defined as a,ll of the students in grades 1-9 who. 
were receiving Instiruction in career education from teachers participating ^n^^ 
each^of the seven experimental career education projects, teachers who parti- 
cipated in the project were.definad as those who iyere selected to complete a 
monthly teacher self -evaluation form* The '^control'' population was defined as 
selected classes of students in either the e:scperlmentai projects or in separate 
schools who, according to the project difectprs or the school principal, respec-^- 
lively, had not received formal instruction in the area, of career education, in 
tliose instances where not all of the teachers were participating in the exemplary 
project, the project director selected classes of students witHin the school dis- 
trict which were to serve as an appropriate control group. In inst.anee.s v:here ; 
cill d£ the teachers in the district were iinvolved it), the experimental project, 
classes of stndents in a separate, but comparable'sbhool in the geographic area 
were selected as the appropriate control group.^ . / 

Table /2 shows the total number of students 'by grade level and by e^^f;^^;/- 
tsental and control groups who participated in the evaluation study. There was 
a total -6f, 10,901 students iiwolved in the- study with 8048 defined as '*exper- - 
losental" students and 2853 definel a^^ **c6ntror?. students^ The numbers of stu- 
dents within each experimental project differed greatly because of the different 
nojnber of teachers participating within each project v Each of the seven proieots 
ax-e nutobered 01 through 07 respectively. 
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BOPULATIOl^'OF STUDENTS IN EJ3>ERlilENXAL AliB COIITROL SCHOOLS 
WHO \>'ERE ADMINISTERED CAREER EDUCATION TESTS Itl GRADES 1-9 



to 

a 

n 

U 

^- 

a 



deB attd r 


01 


02 


03 






On 


07 


{ Total' 




1 ft 






/O f 




206 1 


1 1 Q 


!• 1004 


• 2 


TO ' 

ly 


40 












I 1115 


3 




qo 


4oo 




4 4^ 


^-Sil6: 


129 


j 1197 


Sub Total 


'56 


1 jy 


11 J y 


4J0 , 




k70 


391 


i 3316 


H 


6^ 1 


A / i 




oy ^ ; 




lil04'' 


.125 


i 1257 




■ ■ ■ ' ' 

lb J J 


1 n/» 1 








•ra^iis^ ' (• 


131 


* I4l5 


6i 






J/4 


XUh ' 


'>4h ' 


^ : -133 ^ 


161 


1 1354 


Sub tdtai! 




4.0X 


117^ 




778 i 


— 


437 


: 4026 


■■■ 7 
















196 


8 


Oil 1 

22 ! 






Qi i 
91 ) 


7R 1 




— : 191 


9 


50 


93 ! 




PA J 






— 1 319 


Sub Tdt^i 


106 


! 


— -— -| 








— •• 706 


Total 






1551 j 


/ / Q , 


1 fiPL 




823 


S04S 


1 






a3 ; 


-> J j 




44 


50 


1 315 


2 
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40 
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■ ■ .'- ■ V 


4o 




jy 


Z>4 


49 


52 
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1 47 
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; 144 
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: 293 
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59 I 
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\ 151 
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1 1043 
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76 




54 


100 




j i 290, 
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57 


101 




— i 326 
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75,: J 
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' 96: ^. 
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i' 297- 




' — 1 865 


• total 1 398 


525 


321 


A 60 


! 600 


264 


■:";2-85 


1 2c'd3 
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Test Admlitistrafclon 



The tests weta admlaistered to studenta within the e::perimantal projects by 
QuKstitute teachers fjrom each of the respective school districts. A test adufin-- 
istrat6r*3 tnatiual \^as written and a one day workshop was conduatad to inform the 
stib3titute teachers about the correct procedures for administering each of the 
three career education tests* The staff of the Minnesota RCU administered the 
tests to students in the schools identified as control groups, teats were adii^in- 
is tetrad simltaneously to students in both the e^rperimental and control schools 
durli<^; the first and second week of May, 1973. 



Data kaalysiB 

Data for the K-3 test were keypunched and then scored and analyssed by 
specially dciveloped computer programs. Answer sheets for the 4-6 and 7-*9 
test were read and scored by the optical scanning equipment available at 
the Student Counseling Bureau, Unit^etslty of Minnesota and then analysed 
by specially developed computer programs. The following descriptive sta- 
tistics were used tg analyze the data: (a) frequency, (b) means, (c) stan- 
dard deviations, (d) Hoyt^s reliability coefficient and (e) percentages. 
Means were computed for both total scores and separate scale, scores, but 
only the mean scor^es for ^ the total test are presented in this report. 



FINMNGS- 

Ob je c ttv^^a #1 : 

To deter)3iine whether the cax-eer education tests were 
reliable and capable of dlscriBinafiing among students 
in experiiEental and control groups at different grade 
(maturity) levels in teMis of their mean scores on the 
1-3, 4-6, and j-9 career education tests respectively. 

In ordelr for the three tests to be of any use as a criterion measure, they 
must be reliable ax^d capable of discriminating between or among various criter- 
ion groups. It was hypothesized that if they were reliable and sensitive to 
differences among grade or maturity levels, the tests would than be capable of » 
detecting differences between eKperimental and control projects where, in fact, 
instructional differences existed. * 

Table 3 shows the data for the three ^tests separately by grade level within 
experimental, control, and for the combined groups^f students. The findings 
ate discussed separately for each of tl>e-^hree cat^eer education tests. 

( . - 
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Table 3 



A. COMPARISON OF EKPERll-IENTAL AIJD CONTFIOL GEDUPS 
BY GMBE LEVEL FOR THE 1-3, 4-6 Alffi 7-9 
TESTS RESPECTIVELY 



sum LEVELS 
BY lESTS 


Experimental 

_ 5^ 
N X Corr. Sd r 


Control 
NX Corr. Sd r 


Couibined Groups 

_ % 

H ' X Corr. Sd r 


1 


1004 


12.17 


42%j3.40 


.48 


315 : 12. 21 j 42?: 
1— — U— 


3.44 


.51 


1319 


12.19; 42% 


3.42I .50 


2 


Ills 


15.22 


52f^|3.65 


.56 


3l3il4.5l|50ri 


3.64 


s56 


142S 


14.87; 51S 


3.65: .56 


(29 Items) ^ 
Tottils 


1197 


17.26 


601 1 3. 63 j .57 


317! 16.91 




3.51 


.54 


1514 


17.09.59?:^ 


3.57. .56 

• — . 


3316 


.14.88 




.54| 945|14.S4 




3.53 


,54 


4261 


I4.72j 51% 


3.5S| .54 




125S 


22.28 


km 


6.13 


.71 


293 


21.661 42Si 


5.89 


.69 


1S51 


21.97 


42J^ 


6.0lj .70 


' 5 
4^-6 Teat 


1415 


26.23 




6.3-S 


.74 


3571 


r 

25.S8i50I 


5.93 


.70 


1772 


26.06 


50% 


6.16; .72 


(52 It^ms) g 


1354 


29.10 


561 


6.38 


.75 


393 


28.3.9:552 


6 • 11 1 • 7 2 


1747 


28.75 


55% 1 6.25; -74 


Totals 


40^7 


25.87 


1 SOS 


6.30 


.73 


1043 


25.31! 49?: 


5.9Si .70 


5070 


25.59 


49/ii 6.14- .72 


7 


196 


29.76 




9.34 


.87 


290 


29. 80 '53s 

1 


7.77 


.80 


•4S6 


29.78 


53%! 8. 5 6.'-^. S4 


7-9 Test ^. 
(56 Iteoia) g 

Totals 




32 .7T 


59?f 


8763 


7S5 


326 


133.t?f6m 


8.37 


-.84 


517 


33^.28 


59% j 8. SO tSS 


313 


37.34 


^% 


8.40 


.85 


249 


36,89} 66?{ 


7.54! .81 


. 562 


37.121 67S! 7.97- .83 
! * 


700 


33,29 


..60% 


8.99 


.86! 865 


.-.33.49' 60%23.6S .as 1565 

! ..1 .....1 ... \ ... .. 


33.39 602 3.34 .84 

-r 1 



yindln^ ^s; Test A total of 4261 students were administered the career edu- 

catldn test in grades lf3; 3316 and 945 students ware enrolled in the experl*- 
id^ntal and contrql ^ehool0 reapectivi^iy. 

The tisst appaar^d to be equally reliable for both experimental and control 
sttident:^, although the reliability coefficients were not ^;ery high (averaged 
about .54). Reliability coefficients tanged f ronr ^ low of .45 to a,high of .57. 
In general, the tests seetneaXiio be slightly more reliable for the older students 
than for the younger s^tudentsu 

It seemd apparent that tne 1^3 test consistently detected differences among 
grade ot Tnaturlty levels for both experiitiental and control groups. That is, the 
ineatl scores and percent of items correct were consistenfcly lower for first grad- 
ets than the second gi^^ders and consistently lower for second graders than the 
third gradarr^ for both the experimental and control groups. 
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*the 'coTnii>lete data for each of the experimental and control groups by grade 
level Is showl in Appandl^ The findings previously discussed are also supf 
ported by these data: (1) reliability coefficient^ ranged fro© a low of ,33 
to a high of *75 with the highest reliabilities being achieved by the older ^ 
students and (2) the mean scores for students within each of the experimental 
and contfoi prbjecta was in every case lower for first graders than second 
gradets and lower for second graders than third graders* 

* Findlnga: A^-fi Test ' A total of 5070 students were administered the 4-6 career 
education tests; 4027 students comprised the experimental group with 1043 stu^ 
dents *ln the control group* The test seemed to have equally high reliability 
coefficients for both experimental and control groups^ The aver;age relia^billty 
coefficient was about .72 and ranged from a low o£ .69 to a high of *75, .It 
ai^peared that the test^ were slightly more reliable for the older students thau 
the younger students. ^' - , 

It also appears that the 4-^6 test was^very sensitive to differences among 
grade or maturity levels for students in both the experimental and control 
groups.' That is, in terms of the isaean scores; and percent of items correct, 
fourth graders consistently scored lower than fifth graders and fifth graders 
^ consistently scored lower than si^th graders. 

Appefldix B shows the complete data for each of thjs experimental and con- ' 
trol groups by grade level. These data support the findings previously dis- 
cussed: (1) the average reliability was . 72 arid ranged f rom a lox^ of ,54 in 
one project to ^>igh of .84 in another project and <2) the 4-6 test, in every 
instance, v?as, capable of detecting differences among g:rade or maturity levels \ 
for students in both the experimentaj^-and control groups. j 

Findings: 7-9 Test A total of 1564 students were administered the career ed- 
ucation tests for graded 7^9; 700 were enrolled in expi^rimental projects and 
865 were enrolled in the control schools. ^r:.: 

The 7-9 test appeared to have equally high reliability coefficients for 
students in both the experimental and control groups. The average reliability 
\coefflcient for the combined, groups was .84 and ranged from a low of .80 to a 
high of ,S7\ In general, the test seemed slightly more reliable for the students 
In^the experimentiil projects than for the students iti the control projects. 

The teat also seemed to be quite sensitive to detecting differences among 
grade or maturity levels for students in both the experimental and control groups 
In tertns of meati stores and percent of items correct, seventh 'graders consis-- 
tently scored lower than eighth graders and eighth graders consistently scored 
lower than nlfith graders. j * 
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jejiic complete 4ata for the 7-9 test by grade level for each of the e^qperimental 
and coiitroi groups is shown^ In Appendix B. These data support the ptevidusly dis^ 
-tmased findings that (1) ttie test vas equally reliable for both experimental and 
control groups with the reliability coefficients ranging from a low of .77 to a 
high of • 91, and (2) th§ test, in every instance, was sensitive to differences a- 
Kmg grade or maturity levels for both experimental and eontrpl groups* 

In general, it seems safe to conclude that (a) the A-6 and 7-9 tests have 
hig;her and more satisfactory reliabilities than the 1-3 test although all tests 
veto equally reliable for students. in both experimental and control groups and 
{b) the tests were consistently sensitive to and were capable of discriminating 
among grade or maturity levels for students in both experimental and control 
groups* These findings suggest that the tests are sufficiently reliable and 
sensitive to detect and interpret differences between and among experimentai 
v^tid control groups whete, iti fact, meaningful differences exist. 



Objective //2: To determine whether there were differences between experi- 
mental and control gtoups in terms of the mean scores of 
students on the 1-3^ 4-6, and 7-^9 career education tests 
respectively* * 

A series of three tables are used to present the data concemiiig the relative 
differences between experimental and control groups for each of the three career 
educ^ation tests. These data are intended to demonstrate whether the career edu- 
cation tests are sensitive to differences between students who have received 
formal instruction In career education and those whQ have not received fotmal in- 
struction in career education. It was hypothesised that there would be greater- 
instructional differences (although the exact nature of the differences are ndt 
known) between experiiaental and control groups than ampng the seven experimental 
projects* ^ 

Table 4 shows the data for students in experimental and control groups 
(collapsed across projects) for each of the three career education tests. 

Table 4 

A COIIPARISON 07 EJ^ERIMEHTAL AIID CONTROL GROUlPS 

FOR THREE CAREER EDUCATIO!) tESTS : 



Grades 



Experimental 



Control 



Combined Groups ^ 



N Corr. r N X Corr* r N 'X , Corr. r 



l-^3 Test 
(29 tteaa) 


3316 X4.88 Sl% .54 


945 14.54 50% .54 


4261 14.72 51% .54 


4-6 Test 
(52 \t&m) 


4027 25.87 50% .73 


1043 25.31 49% .70 


5070 25.59 49% .72- 


7-9 Tfisst 
(56 Items) 


700 33.29 60% ^80 


865 33,49 60% .82 


1565 33.39 65% .84 
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I)y eollapsittg th0 data for expet±«itintal and controi" groups for each of the 
three tests j there appears to be alti^ost no different between exterlmental and 
ccrttrpl groups! on any of tbe three tfesti&r the differences between the mean scores 
for ekperiinental and control grqupsion the l-*3> 4-6, and 7-9 career education ' 
test^ are .34^ ♦56 f and .20 res^iedtively. Students in the experimental projects 
for t^sts 1-3 and A-6 had slightly Jii^her mean scores than the students in the 
control group > but the trend was reversed for the 7-9 test; students in the con- 
trol groups scored higher than students in the experimental groups. It- should 
be noted, however, that students lii only three experimental and control schools 
were adirtlnistered the 7-9 test, thiis, the comparitiye difference's may be mis- - 
leading*- The average percent of items correct and the average reliability co- 
cJfficiciits for students in the experimental and control groups were almost 
identical. | 

Table 5 p^resents the data separately for each of the matched experimental 
and control projects (sites) according to student performance on the l-'3, 4^6, 
and 7^9 career education tests respectively. *There appear to be very little 
difference in >the mean scores Of students between each of the matched experi- 
tsental and conttol groups for any of the thre^ career education tests, although * 
the reliability coefficients for the matched projects'are quite similar and ap- 
pear to be within the range of acceptance* * 

■*«"•'' * ■ ■ " 

Mfferetices in mean seorfes for nmtched control-experimental groups for, the 
1-3 test ranged from a low of -.51 in favor of the-.control project group (ptoject 
06) to a high of +1,06 in favor of the experimental group (project 07). While 
taoat of the observed differences were not very large, it appears that experi- 
oental students consistently • scored highet on the test than their counterpatts 
In the control groups. ' 



"^^^ differences in mean scores for matched experimental and control groups 
for the 4-6 test ranged from a high of ,64 in favOr of a control group ("project 
05) to a high of 2.34 in favor of an experimental group (project 04). I'he reli- 
ability coefficients wete approximately the same and satisfactorilv high for each 
•df the matched experimental and control groups. Four out of the. seven corapari- 
sorts of differences in mean scores favored the experimental groups and the re- 
tialiting three comparisons favored the Control groups. 
. ^ ' ■ i - \ ■ ■ ' 

Matched exp^rimefttal and control groups for thia 7-9 career educ^tl^m test 
vero. available for, only three projects which involved a total of 1472 i tudents. 
Ttie reliability coefficients were quite high and very similar for eacli i f the 
mte^ied experimental and control groups^ The largest difference betwytti mean ' 

^" °^ ^ conttol group. Of the three comparisonf. fiade, 

^vSfM t.ie differences favored the control groups and only one favored the 
exE^erimental group. 

The complete data for each of the experimental and control groups is pre- 
^u.{u*»d by grade level in Appendix B. VJhile- it Is apparent that the differences 
y^t^t'iin t'^iperlmental and control projects ace not very large, it seems im'-)or- 
!f : "^f **«sesiJ-whethet there is a trend in favot of the experimental Or the 

(.-■^ntrol' groups* , , , 

Table 6 gumraatlzes" the data 'by grade level foe the l«-3 and 4-6 career edu- 
tfsts In terms of the nuraber of timpa the mean scores for the experliu^ntal 
» . 'U^fj vete hxghet or lower than the ifiean scores tor the matched control groups. 
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Data cire not pireseOTed for the 7-9 test because of the limited number of 
comparisons and projects involved. ,. 

t 

table 6 

.liUMBER OE TltffiS THE SCORES OF EXPERBIEN'TAt 

GROUPS VSRE HIGHER OR LOUER TiL&^T CO:^TRQL 
GROUPS FOR TESTS 1-3 





Grade 1 


Grade 2 


Grade 3 


Totals 


■ ■ — - 

Higher 


4 

19% 


5 

23% 


5 

. 23% 


14 

67% 


tLower 


3 

14% 


2 

10% 


2 

10% 


7 

33% 

J - ■■ ■■■ ■■ ' 


Totals 


7 

33% 


7 

• 33% 


^ 7 

33% 


21 

100% 



Table 7 



Nm-ffiER OF Tll'ffiS THE ME.AI-l TEST SCORES OF EM^ERiMENTAL 
GROUPS 17ERE HIGHER OR LOKER 'THA.%' COKTROt " ' 
GROUPS FOR GRADES 4-6 



VI, 





Grade 4 


■ Grade 5 


Grade 6 


Tdtals 


Higher 


3 

14% 


4 

19% 


3 

14% 


10 

48% 


lower 


4 

19% 


3 

14% 


4 

19% 


11 


Totals 


7 

33^* 

II \ .■ 1. 1 • '11. „ ■ 1 ' 


7 

33% 

■ ■■ , . -T -- 


7 

33% 


• 21 

100% 
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The data suggest: that there 'seems to be a trend for experimarttal students td 
<^c^ora higher on the 1-3 career eduisation test than their counterpart control groups 
WZ o{ the eomparisans vera in favor of the experiniental groups and 332 favored 
tlm Gdtttrol groups) , SiMlar trends do not exist for the students who took the 

test. Forfey-^eight pex-aent of ^the -comparisons favored the ^Mpariniental groups, 
^^t fifty-»two percent of the comparisons favored the control groups* 
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It seems safe to conclude that there was telatlvely little difference between 
tlie performances' of students in matched eKperimental and control groups. The three 
tests seemed quite reliable and capable of detecting differences, but the taagnltude 
of these differences waa^ relatively small* On the other hand, while the magnitude 
of the differences were relatively small, there does seem to be a trend (at least 
in grades 1-3) for students in experimental groups to score higher on the tests 
than students in the control groups. These trends vjere not as evident for students 
in grades 4-6 and appeared to be reversed for students in grades 7-9 (control groups 
scored higher than experimental groups). 

it is also interesting to point out that the tests appeared to be equally re- 
liable for both eiiperlmental and control groups and have suf ficientl:/ high relia- 
bility coefficients (v:^ith the possible exception of the 1-3 test) such that the 
findings can be interpreted with a degree of confidence. 

Objective.. #3: 

To determine whether there were differences among seven (7) 
exemplary career eduaStion projects in terms of the mean scores 
of students on the 1-3, 4-6, and 7-9 career education tests 
respectively. 

One of the origiiial goals of the seven ^ite career educatib|i model ^as to 
pr^>vide each site the opportunity to implement the concept of carreer education 
in different ways and using different combinations of instructionajt tech^iiques. 
The purpose of this abjective is to determine whether the three career educa-- 
tlon tests were sensitive to instructional differences among the seven (7) e>:- 
.pj^jclmaatal projects. ^ . ^ . 

Table 8 shows the combined mean scores and reliability coefficients for each 
of the seven eitemplary projects for the 1«3, 4-6, and 7-»9 career education tests 
i^espectively. Data are collapsed by grade level for each of the cnperimental pro- 
jects for each o/ the three tests. 

A total of 1316 students in the seven (7) exemplary projects were admini-- 
stered the 1-3 e^^reer education tests. 

The data shewn in Table 8 suggest that while the test was apparently sensi- 
tive to dilfereives amang enemplar^^ projects, the magnitude of these differences 
Vwere quite small. The mean scores ranged from a high of 15.29 to a low of 14.19 

d.if feren £ in mean scores ranged from a low of .04 to a high of 1.1. Con*- 
siderlng data we' e collapsed across grades, these differences can hardly be thought 
to be "edu^ration illy significant*'. The reliability coefficients for the^ compari-- 
smn we-re iieneratly low (average of .53) but were quite consistent among the com- 
parison grcups. While slight differences were detected, it is not known v;hether 
theae were due to instructional differences among the prograsas or to the reliability 
of the tei-tii. /ddltional research may be needed to answer this question. 

A total of 4027 students in the seveti (7) exemplary projects were adminis- 
tered the 4-6 career education test* The meaA scores for the seven projects 
rmgoxi from a high of 26.80 to a low of .24.16. Differanees. in mean scores among 
iuc*|f^e,tc| r^^aged from a high of 2*64 to a low of .16. 'iha teat seemed t© be quite 
reliable for all of the comparison groups; the average reliability coefficient 
i73 and the coefficients ranged from a low of * 70 to a high of .76. 
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Table 8 



A COOTARtSOri Of SEVEJI EXEMPURY PROJECTS 
ii IN. TERI-fS OF THE CO>IBINED DATA FOR ^ 

'three career educatiqn tests'"^ 









GRADE levels: 












1-3 




4-6 




7-9 






N 


X 


r 


N X 


r 




t 


UX 






.47 


42:2 24.16 




XUo £.y*)?v 


.90 


uz 


139 


14.32 






• ' H 


2 

Q^a: 7«t 


* oU 


03 


1520 


14.96 


.57 


1178 26.80 


.72 






04 




14*19 


.57 


276 26.59 


.76 


348 32.65 


.^84 


05 


663 


15.07 


.50 


778 25.23 


.71 


243 34.21 


*83 » 


06 


670 


14.82 


.45 


775 25.39 


.76 






07 


391 


14.92 


.59 


437 26.14 


.71 






Totals 


3316 14.80' 


.53 


4027 25*87 


.73 


700 32.29 


.86 



















Pata are collapsed By grade levels for each te3t# 
Data shown are only for 9th grade students. 



It appears that the 4-6 tmt vas capable of reliably detecting differeneea 
among exemplarj^ projeets. Because the reliability for the , teat wa^ quite; high,, 
the findings may suggest that there may, in fact^ b^ differences in Instructional 
ettephasls among the prajeets and that the 4-6 te^t is capable of. detecting these 
differences. ^ 

A total of 700 sttident2§ in the exemplary prDjecta were admtttlatered the 7-9 
career education test* the test seemed capable of reliably detecting rather large 
differences among the four e!<emplary proje^cts vhich Involved junior, high school ^ 
atudent^* Excluding the one group of ninth grade students (project 02) from the 
cdtsparlsons^ the mean scores of the three projects ranged from a low of 29.99 to 
a high of 34,21 and vil^lded a range of dif ference_s. in mean scores from a low of 
2.66 to a high of 4/32* The 7*-9 test was the most reliable of the three career 
education te^ta; reliability coefficients for the comparisons ranged from a low 

,80 to d high of .90^ yielding att average reliability of .86, Againy because 
the reliability of ■ the comparisons were quite high /the findings may suggest 
that students in the three projects did receive dif ferent types or amounts of 
inatruetion or that the students were already quite different in terms of their 
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knowledge of "work" before t\h career education projects ware started. 



The coiaplete data by grade ^leve l for the seven exemplary projects are shown 
In Appendix^ B. l-Jhila these data sup^rt the previous finding coueerning the re- 
li^ablilty of the three tests and the relative differences a»ng the sBvm i7)\^ 
, exetnplary ptojetcts, the dlffeirencea arcl not very systeiQatle when grade level la*' 
considered. That is, when making coicparisons among the projects by grade level, 
the first graders may score higher in onKj?5oject than in aiiother project, but 
the s.ituatlon taay be just the opposite when'^'"6«4isparin8 differences in meun scores 
for the secdVid and third graders in the same ^rojeMa* This may indicate that 
teachers at certain grade levels within a project wyre more involved with career 
education than teachers at other grade 'levels and that the emphasia at various' 
grade levels was not consistent among the seven cSsemplary projects. 



■ \ ^ LIMITATIONS, SWfcMt, AI1D CONTUSIONS 

Limitations \ 

This study hak two types of limitations. The first pertains to the way in 
which the experimental and control populations ware identified. The second lim- 
itation involves the validity and reliability of the tests. 

The e:<perliasntal population was defined as all of the students who had re- 
ceived instruction from teachers who were participating in the career education 
project ^s identified by the director of eaj^h projact. \Jhilje the "process" 
evaluation provides clues as to the amount of time teachers devoted to career 
education actlvltiea and a gross estimte of the content, the eKaet content of 
their instruction as related to the tests which wer^ admltiistered to their stu^ 
denta is not kiaown. Also, because of the'way inllchTch" '*^eontTOl^^^^ 
identified, it ±b not known whether ^or how these students differed from students 
in the e^rperteental project in terms of their knowledge of ^career education or 
in- term of hov much (if any) instructional' emphasis was placed on career edu- 
cation. All that can be said is that these students ware not iiecelvlng "for*^ 
mal" instruction in career education, but it is entirely possible that teachers 
in these schools did, in fact, teach concepts related to career education as a 
part of their regular day-to-day classroom instruction. In general, it is not 
possible to atta^ibute any causal relationshipra from the findings, however, it 
is possible/ to describe differences where differences existed and attempt to 
suggest .possible reasons for these differences. 

The second limitation of the study pertains to the validity and reliability 
of the three career education tests. The^ tests were' developed in a manner thdt 
was internally consistent with the rationale and theoretical model for career 
edncatidn developed by the Minnesota ECU. >Jhlle the project directors were some- 
what familiar with the rationale and modeL, it is likely that their teachers had 
either no knowledge or at least only limited knowledge ot it. Also, neither the 
teachers or^directora had advance knowledge iabout: the concepts Included in the 
t§3ts. Thus,* the tests and the findings of the study truly represent an cisternal 
evaluation of what students should theoretically have. learned rathdr than what 
they may, in fact, have learned, it may very well be that the^ tests have limited 
content validity in terms of the concepts teachers emphasised in th^lr "fnstruc-- 
tional activities. In addition the findings are limited by the reliability ©f 
the instruments. In Instances where test reliabilities are low, * the validity 

177 



47 - 



j 



I of the findings my be questioned* Howeveri as has been previously sh©wi, the 

4-6 and 7'-9 tests appear to be quite reliable and thus should yield ^^lid and 
meaningful eonelusions. Less confidence can be placed ah the conclusions 
dealing with the 1-3 career education test. 



Summary^ , , 

" tiiB sutBiuary of the study follov.^' the sequence in which the objectives and 
findings of the Btudy were dlacuased. The major findings of the study are -sum- 
marised below. 

, 1. Each of the three career education teats appear to be sensitive 
to differences among grade or mturity levels for both er.peri-^ 
mental and control groups. • IJl'iile these differences were not * 
large** they were, in all instances, consistent for eKperimental 
and control groups separately and collectively. 

2. Each of tile three career education tests were equally reliable 
for eKperi^entai and control groups. The average reliability 
coefficients for the 4«6 and 7-9 tests were .75 and .85 respec- 

^ tively and were sufficiently high to', place confidence, in the 
findings of the study. The average reliability for the 1-3 
* " test wa^ only about .*54» ^this may ©uggeat ih.at when = differ- 
' ■ ences ware reported ihef^iay, in feict, b^ real differences or - 
% be differencea attributable^© low "reliability.^ (The low re-_ 

liability for the 1-3 -test was probably due to the length of 

-^-^ ^l^^ ^^^^ (only 29 items) rathejt>-fctem to any inconsistency in 

student responses.) , ' . 

3. Students In e::periraental projects tended to have slightly 
higher mean scores on the 1-3 and 4-6 car^^^^^r educatilon testa' 

I , than their respective control groups* Converaely, students 

in the control groups tended to have a higher sean score on 
the 7-9 career education test than their respective enperi- 
3 * ^ mental groups. Differences fc^r the 1-3 test tended to be 

J ■■■ _ quite small, but were considerably larger for the 4-6 and 

*Z-9 te^ts. In general, the testa seemed to be capable of 
. detecting differences between eKpertiaental and control 

J ' 'groups where, in^fact, differences eKiet» 

^ - 4. There were differences amon^ the seven/eHperi©ental projects 

I in terms of the sean scores of students for each of the three 

career education tests. ■ These differences were quite small 
for the 1«3 test, but were considerably larger for the 4-6 
I ^ and 7-9" tests. Howa^'^er, by looking at .the mean scores ©t the 

I ^ seven exemplary projects by grade level , 'inconsistencies are 

evident. That is, it seemed evident that instructional em- 
I '■ . phasis at various grade le^'^els were quite different^ among the 

I . seven projects, consequently systematic differences among the 

flp projects by grade level were not e^d.dent. 
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Conclvislohs; 

• The conclusions are presented In relationship to the two major purposes of 
the study ; ,. ■ _ 

(1) to develop a JielS^SfLei \ralid set of career education instruments 
designed to measure »JI cognitive achievement of students in grades 
1-9, and (2) to assess the relative impact of career education pro- 
jects on student achievement. 

In general, it seems safe to conclude tliat the three career education in- . 
-struraents used in the study were quite reliable and valid in terms of detecting 
Eieaningful* differences among various criterion groups of students who were ad- 
slnisteted the tests. I#''is apparent that the 4-6 and 7-9 tests possess adequate- 
feliahllity for the purpose of making meaningful comparisons among a wide range 
<)f Criterion groups. There may, however, be some question about the reliability 
of/the 1-3 t6st. • It seems likely that this test may have to be lengthened before 
its reliabilitv can be improved.' However, it is encouraging to note that each of 
the tests were' capable of detecting differences (however slight they may have been) 
ataong various criterion groups. They were able to detect differences among grade 
(maturity) levels of students and to detect differences between fexperimental pro- 
jects. It is, therefore, concluded that the findings discussed In the study are 
based on the use of instruments which have demonstrated f eliabillfcy -an<i construct 
validity. 

In terms of the relative impact that the career education projects had on 
students, it seems safe to conclude that the impact was minimal. There were 
only slight differences between experimental and control students or among stu- 
dents in the-^exemplarv ypro jects . However, while the magnitude of these differ- 
ences were slight^ thkse differences (except in grades 7-9) tended to favor 
students in the experimental projects. 

Obviously, this report raises many interesting (if not perplexing)' questions 
eoncerning both the characteristics of the instruments as well as the relative im- 
pact (or lack of it) of career education instruction on students. Part III of this 
report will attempt to address these questions by interpreting the results of the 

• findings for the i>rocess and product evaluations and speculate about the relation- 
ship between the ti'O sets of findings. 
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APPENDICES 



Appendix A: Coiiteut Dom^itt^ and Elexa^ne^^ 

for Car^ef Educatiotx Tests K^9 



Appendix B : 



A Coifiparlson of Exp^riBiental and Control 
Projeetls by Grade -^Level aa Measured by * 
Total Test Scores 
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Appendix A 
Table 1 



CONTENT DOMAINS AND ELEMBilTS OF COHTENT 
- FOR CAREER' EDUCATION TESTS K-9 
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PART III 

INtliRPREtATlONS OF ThE I'lHDINGS . . 



The purpose. of this section is to relate the findings of the process and product 
evaluations aild suggest some plausible explanations for these findings. This 
«Jis-tission may provide a basis for modifying the evaluation process or instrurnen- 
taticin or it may encourage modification- in the way career education is iiiipleraented in 
the seven project schools . . 

in terras of cognitive achievement, findii^gs indicate that career education 
itt>9truction Apparently had relatively little impact in producing differences (a) 
between matched groups of experimental and control students and (b) among the students 
in' the different experimental projects. That is, any differences observed, t^ere 
'tjaall and not always in favor of the -experimental projects. Three plausible ^'lan- 
ii'tions could account for these findings: (1) Itt:Strumencs used to assess the c^»?*i4iv^ 
ac-hieveinents of students may not have been valid or reliable, (2) Selection of matched 
control groups may have been Inappropriate or (3) instruction in career education 
Kiy have been inadequate in terms of the processes used and/or the instructional time 
spent on career education during the first year of the project. Each of the three-" 
JEaCtora is discussed separately in the sections that follow. 

Validity of Criterion Instruments — 

The criterion instruments were developed in a manner that was internally 
consistent with the rationale and model for career education developed by the 
tnfc'tobers of the staff of the Minnesota RCU. Items included oh the test were 
selected on the basis of their ability to (a) dikiriminate among students at 
different grade levels and (b) reliably measure the concepts suggested by the 
rationale (based on a pilot test of the items).. The test items represented only 
a sample of the types of concepts derived from the theoretical model of career 
education. The items were reviewed by several individuals and groups who were 
kitowledgeable about concepts related to career education. In most instances the 
itetas were judged to bet an adequate sample of important career education concepts. 
However, a discrepancy between what career education could theoretically teach^ 
and What teacliers said they taught became obvious, therefore the instruments may 
have had limited dace validity. Regarding construct validity, it was r.easoned 
that if the tests could reliably detect differences in student performance among 
grade -levels,, then it was likely that the tests could also detect differences 
among or between programs which differ in the amount of instructional, emphasis 
related to career education. The tests did show internal reliability and a 
capability for discriminating among students at different .grade levels, for both 
the experimental and control groups . 

However, it may be argued that the reason larger differences were not found 
between or among the experiraeital and control projects was -that test ittiims did. . . 
not sample the content taught. Because of the way in which items were derived, it . 
seems unlikely trhat they were totally unrelated to the content or concepts tausjht 
bv teachers ever, though teachers indicated they placed more emphasis on the develop-. 
mnt of attituAtJs thmt thev did on cognitive contea|. Re.E^ardless. of the reason, 
the findings do suggest that additional effort should be devoted to modifying the. 
items and improving the content validity of these cognitive instruments. 
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Trif^ntl fleatlon of Control Groups : .-.Xl 

- — -~ " - , U 

Another factor which niay help to e>:Y*^lain the relatively small obsea-ved differences 
l^etweeit the mean scores* of studentiS.ln experimental and control groups is the manner l-j 
itt vhieh control groups were identified* In general, control groups vere Identified 
4?-r by either a project director ci^r^^ School principal as those teachers v:ho (to their 

^ Unov;ledge) had not modified their course content to teach career education concepts. hi 
. It is liheiy th^t all' teachers, to some eKtent, teach concepts related to career ^ 
education as a part of their regular course content, and that educationally signlf-- 
icant differences could not be detected because career education concepts vjere, in 
fact, taught to students ivi the control schools. This does not imply that students 
in the experimental projects did not learn more about career education |fhan students 
^ in the control groups, it simply means that they did not learn the concfipts 

included on the t^sts of cognitix^e achie\^ement and thus educationally s^lgnificant 
differences were viot detected between experimental and control proj^fects^. 

Fjviphasis on Career Education Instruction : 

Another factor that could explain the relatively small differences in the 
mean scores of students between and among experimental and control groups was the 
^^mphasis placed on career education by the teachers in the experimental projects. 
Instructional emphasis v:as determined by the responses of teachers to, the monthly 
self--evaluation fortu used to describe the -"processes" teachers used t^ implement 
career education in thair classrooms. The basic question seems to be/ "Did teacheri^ 
spend enough time on career education activities and spend it in a manner that 
would most likely make the greatest impact on student aclvlevement?" 

A partial ansvjer to this question may be provided by looking at a "instructional 
profile" of an aver age career education teacher for a seven month period. The 
average teacher conducted twenty career education actii^ities that v;ere integrated 
with regular course content. These activities required a total of thlrty«five hours 
of instruction and preparation time, which v^as devoted primarily .to 'concepts such 
as self -awareness, occupational industries, and general kno,wledg^ about wor>kers. 
Stated in another way, the average teacher spent about ^f ive (5) houjrs a month or 
1.25 hours per week on career education activities that were integrated with the 
, regular course content. This suggests that less than three percent (2.432) of 
the teacher •s time was spent on instructional activities that xcere specifically 
identified as career education instruction. * 

Assuming that" the data provided by teachers on the self -evaluation form were 
accurate, it can be argued that the amount of instructional emphasis and/or the 
integration of career education concepts with regular course content was inadequate 
for mking an obserirabla impact on the cognitive achievement of students in the 
experimental projects. This conclusion suggests, that if an observable impact on 
the cognitive achievements af students is desired, the instructional profile in 
the experimental projects needs to be changed. It could be changed in the following 
vays: (a) conduct more instructional activities related to career education, 
Cb) devote more and a greater* percent of time to career education each day, week 
or month, (c) modify instructional emphasis to include concepts' related to the 
Mreer planning process, occiipational le\^els and work role requirements, and 
ii\y teach career education concepts as separate units, classes or at least as 
fieparate Identifiable aspects of the instructional process rather than inttsgrate 
the concepts with regular course content. It is also plausible that in one year, 
It ia not possible to detect lar^^er or more educationally significant- differences 
in tliO cognitive achievement of students between' or among the various criterion 
groups than those observed in this study. 
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It seems likely that the findings pertaining to the impact of careei* education 
on the cognitive achievement of students can best be explained in terms of a 
combination of the three factors previously discussed. Therefore, in order to 
detect a greater impact on the aognitix^e achievement of students in subsequent 
years, it may bo necessary to (a) modify and improve the sensitivity of the three 
cognitive aareer education tests, (b) iocntify and more appropriately specify 
the characteristics of. the control population, (c) encourage teachers to (1) place 
greater instructional emphasis on a broader range of career education concepts 
than they had done proviously and (2) make career education instru-^tion a more 
Identifiable aspect of the instructional program. Additional efforts to evaluate 
these projects in subsequent years may be required in order to answer many of the 
questions raised by this discussion. 
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